Spaces:
Runtime error
Runtime error
how it is able to answer 2nd question? is there any llm giving this answer?
#1
by
ABeyonder
- opened
๐: Prime factorization of 68
๐ค: [2, 2, 17]
๐: who is prime minister of india?
๐ค: Narendra Modi
in the mcp client code, I don't see any llm getting used, so how it is able to answer questions like
who is prime minister of india?
what is the capital of India?
ABeyonder
changed discussion status to
closed
ABeyonder
changed discussion status to
open
@ABeyonder
by default, the InferenceClientModel
class uses the Qwen/Qwen2.5-Coder-32B-Instruct
model
def __init__(
self,
model_id: str = "Qwen/Qwen2.5-Coder-32B-Instruct",
provider: str | None = None,
token: str | None = None,
timeout: int = 120,
client_kwargs: dict[str, Any] | None = None,
custom_role_conversions: dict[str, str] | None = None,
api_key: str | None = None,
bill_to: str | None = None,
base_url: str | None = None,
**kwargs,
):
...