|
Download README.md from CyCraftAI/CLinker: direct link, hf CLI and curl.
- Browser
- Download file 2.13 kB
-
https://huggingface.co/CyCraftAI/CLinker/resolve/main/README.md
- Command line
-
hf download hf://CyCraftAI/CLinker/README.md
-
curl -L -H "Authorization: Bearer $HF_TOKEN" -o README.md https://huggingface.co/CyCraftAI/CLinker/resolve/main/README.md
2.13 kB
| datasets: | |
| - CyCraftAI/CyPHER | |
| extra_gated_fields: | |
| First Name: text | |
| Last Name: text | |
| Date of birth: date_picker | |
| Country: country | |
| Affiliation: text | |
| Job title: | |
| type: select | |
| options: | |
| - Student | |
| - Research Graduate | |
| - AI researcher | |
| - AI developer/engineer | |
| - Reporter | |
| - Other | |
| geo: ip_location | |
| # CLinker | |
| The CLinker models are distilled language models specifically designed for command-line graph construction, developed by CyCraft AI Lab. CLinker was instroduced in SINCON 2025, with talk titled "CLINKER — An Efficient Distilled LLM Command Line Graph Constructor". | |
| ## Usage | |
| ### Launch openai-compatible server (e.g., vllm) | |
| ```bash | |
| python3 -m vllm.entrypoints.openai.api_server \ | |
| --host 0.0.0.0 \ | |
| --port 3000 \ | |
| --served-model-name $model_name \ | |
| --max-model-len $length \ | |
| --api-key $api_key \ | |
| --model $model_path | |
| ``` | |
| ### DSPy inference | |
| ```python | |
| import dspy | |
| # Set dspy module default LM | |
| lm = dspy.LM( | |
| model=f'openai/{$model_name}', | |
| api_key=f'{$api_key}', | |
| api_base='http://localhost:3000/v1', | |
| model_type='chat', | |
| temperature=0.7, | |
| max_tokens=4000, | |
| cache=False, | |
| num_retries=0 | |
| ) | |
| dspy.configure(lm=lm) | |
| ``` | |
| ```python | |
| from command_parser import CmdlineParser, CoTCmdlineParser | |
| from command_extractor import CmdlineExtractor, CoTCmdlineExtractor | |
| cmdline = 'echo hello world' | |
| # Reasoning model `CLinker-DeepSeek-1.5B` use non-chain-of-thought prompt | |
| parser = CmdlineParser() | |
| extractor = CmdlineExtractor() | |
| # Non-reasoning models are equipped with chain-of-thoughts prompt | |
| parser = CoTCmdlineParser() | |
| extractor = CoTCmdlineExtractor() | |
| # Run inference | |
| parser_response = parser(cmdline).toDict() | |
| extractor_response = extractor(cmdline).toDict() | |
| # Transform Response: pydantic.BaseModel object into dict | |
| parser_response['response'] = parser_response['response'].model_dump(mode='json') | |
| print(parser_response) | |
| print(extractor_response) | |
| ``` | |
| ### Graph construction | |
| ```python | |
| from command_graph_builder import build_cmdline_graph | |
| graph: nx.DiGraph = build_cmdline_graph(cmdline, parser_response, extractor_response) | |
| ``` |