Skip to main content

Inference Model

Inference models are neural network architectures designed for natural language processing tasks. They analyze input text to generate responses, answer questions, make predections, or summarize content.

In Therix, we make it easy to use many popular inference models. You can choose the best one for your needs, depending on what you're trying to do. Whether you're analyzing data, recognizing patterns, or making predictions, we've got you covered with simple integration and a variety of options to suit your specific use case.

1. OpenAI GPT3.5 Turbo​

  • Import the OpenAIGPT35TurboInferenceModel model from therix.core.inference_models
from therix.core.inference_models import OpenAIGPT35TurboInferenceModel
  • Add the model to agent configurations using the add method
.add(OpenAIGPT35TurboInferenceModel(config={'api_key': // Your openAi API key here}))

2. OpenAI GPT4​

  • Import the OpenAIGPT4InferenceModel model from therix.core.inference_models
from therix.core.inference_models import OpenAIGPT4InferenceModel
  • Add the model to agent configurations using the add method.
.add(OpenAIGPT4InferenceModel(config={'api_key': // Your openAi API key here}))

3. OpenAI GPT4 Turbo Preview​

  • Import the OpenAIGPT4TurboPreviewInferenceModel model from therix.core.inference_models
from therix.core.inference_models import OpenAIGPT4TurboPreviewInferenceModel
  • Add the model to agent configurations using the add method.
.add(OpenAIGPT4TurboPreviewInferenceModel(config={'api_key': // Your openAi API key here}))

4. OpenAI GPT4 Omni​

  • Import the OpenAIGPT4OInferenceModel model from therix.core.inference_models
from therix.core.inference_models import OpenAIGPT4OInferenceModel
  • Add the model to agent configurations using the add method.
.add(OpenAIGPT4OInferenceModel(config={'api_key': // Your openAi API key here}))

5. OpenAI GPT4 Omni mini​

  • Import the OpenAIGPT4OMiniInferenceModel model from therix.core.inference_models
from therix.core.inference_models import OpenAIGPT4OMiniInferenceModel
  • Add the model to agent configurations using the add method.
.add(OpenAIGPT4OMiniInferenceModel(config={'api_key': // Your openAi API key here}))

6. Azure OpenAI GPT3 Turbo Preview​

  • Import the AzureOpenAIGPT3TurboPreviewInferenceModel model from therix.core.inference_models
from therix.core.inference_models import AzureOpenAIGPT3TurboPreviewInferenceModel
  • Add the model to agent configurations using the add method.
.add(AzureOpenAIGPT3TurboPreviewInferenceModel(config={'azure_api_key': // Your azure API key here}))

7. Azure OpenAI GPT3 Turbo Instructnference Model​

  • Import the AzureOpenAIGPT3TurboInstructnferenceModel model from therix.core.inference_models
from therix.core.inference_models import AzureOpenAIGPT3TurboInstructnferenceModel
  • Add the model to agent configurations using the add method.
.add(AzureOpenAIGPT3TurboInstructnferenceModel(config={'azure_api_key': // Your azure API key here}))

8. Azure OpenAI GPT4​

  • Import the AzureOpenAIGPT4InferenceModel model from therix.core.inference_models
from therix.core.inference_models import AzureOpenAIGPT4InferenceModel
  • Add the model to agent configurations using the add method.
.add(AzureOpenAIGPT4InferenceModel(config={'azure_api_key': // Your azure API key here}))

9. Azure OpenAI GPT4 Turbo Preview​

  • Import the AzureOpenAIGPT4TurboPreviewInferenceModel model from therix.core.inference_models
from therix.core.inference_models import AzureOpenAIGPT4TurboPreviewInferenceModel
  • Add the model to agent configurations using the add method.
.add(AzureOpenAIGPT4TurboPreviewInferenceModel(config={'azure_api_key': // Your azure API key here}))

10. Azure OpenAI GPT4 Omni​

  • Import the AzureOpenAIGPT4OInferenceModel model from therix.core.inference_models
from therix.core.inference_models import AzureOpenAIGPT4OInferenceModel
  • Add the model to agent configurations using the add method.
.add(AzureOpenAIGPT4OInferenceModel(config={'azure_api_key': // Your azure API key here}))

11. Groq Mixtral87b​

  • Import the GroqMixtral87bInferenceModel model from therix.core.inference_models
from therix.core.inference_models import GroqMixtral87bInferenceModel
  • Add the model to agent configurations using the add method.
.add(GroqMixtral87bInferenceModel(config={'groq_api_key': // Your groq API key here}))

12. Groq Gemma7B​

  • Import the GroqGemma7B model from therix.core.inference_models
from therix.core.inference_models import GroqGemma7B
  • Add the model to agent configurations using the add method.
.add(GroqGemma7B(config={'groq_api_key': // Your groq API key here}))

13. Groq Llama3x70b​

  • Import the GroqLlama370b model from therix.core.inference_models
from therix.core.inference_models import GroqLlama370b
  • Add the model to agent configurations using the add method.
.add(GroqLlama370b(config={'groq_api_key': // Your groq API key here}))

14. Groq Llama3x8b​

  • Import the GroqLlama370b model from therix.core.inference_models
from therix.core.inference_models import GroqLlama38b
  • Add the model to agent configurations using the add method.
.add(GroqLlama38b(config={'groq_api_key': // Your groq API key here}))

15. Groq Llama 318B​

  • Import the GroqLlama318B model from therix.core.inference_models
from therix.core.inference_models import GroqLlama318B
  • Add the model to agent configurations using the add method.
.add(GroqLlama318B(config={'groq_api_key': // Your groq API key here}))

16. Groq Llama 3170B​

  • Import the GroqLlama3170B model from therix.core.inference_models
from therix.core.inference_models import GroqLlama3170B
  • Add the model to agent configurations using the add method.
.add(GroqLlama3170B(config={'groq_api_key': // Your groq API key here}))

17. Groq Llama 31405B​

  • Import the GroqLlama31405B model from therix.core.inference_models
from therix.core.inference_models import GroqLlama31405B
  • Add the model to agent configurations using the add method.
.add(GroqLlama31405B(config={'groq_api_key': // Your groq API key here}))

18. Bedrock Text ExpressV1​

  • Import the BedrockTextExpressV1 model from therix.core.inference_models
from therix.core.inference_models import BedrockTextExpressV1
  • Add the model to agent configurations using the add method.
.add(BedrockTextExpressV1(config={ "bedrock_aws_access_key_id": // Your bedrock access key,
                                    "bedrock_aws_secret_access_key" : // Your bedrock secret key,
                                    "bedrock_aws_session_token" : // Your bedrock session token,
                                    "bedrock_region_name" : // Your bedrock region
                                    }))

19. Bedrock Text Premier G1​

  • Import the BedrockTextPremierG1 model from therix.core.inference_models
from therix.core.inference_models import BedrockTextPremierG1
  • Add the model to agent configurations using the add method.
.add(BedrockTextPremierG1(config={ "bedrock_aws_access_key_id": // Your bedrock access key,
                                    "bedrock_aws_secret_access_key" : // Your bedrock secret key,
                                    "bedrock_aws_session_token" : // Your bedrock session token,
                                    "bedrock_region_name" : // Your bedrock region
                                    }))

20. Bedrock Lite G1​

  • Import the BedrockLiteG1 model from therix.core.inference_models
from therix.core.inference_models import BedrockLiteG1
  • Add the model to agent configurations using the add method.
.add(BedrockLiteG1(config={ "bedrock_aws_access_key_id": // Your bedrock access key,
                                    "bedrock_aws_secret_access_key" : // Your bedrock secret key,
                                    "bedrock_aws_session_token" : // Your bedrock session token,
                                    "bedrock_region_name" : // Your bedrock region
                                    }))

21. Gemini Pro​

  • Import the GeminiPro model from therix.core.inference_models
from therix.core.inference_models import GeminiPro
  • Add the model to agent configurations using the add method.
.add(GeminiPro(config={ "google_api_key" : // Your gemini api-key}))

22. Gemini 1.5 Pro​

  • Import the Gemini_1_5_PRO model from therix.core.inference_models
from therix.core.inference_models import Gemini_1_5_PRO
  • Add the model to agent configurations using the add method.
.add(Gemini_1_5_PRO(config={ "google_api_key" : // Your gemini api-key}))

23. Anthropic Claude Opus​

  • Import the Anthropic_Claude_Opus model from therix.core.inference_models
from therix.core.inference_models import Anthropic_Claude_Opus
  • Add the model to agent configurations using the add method.
.add(Anthropic_Claude_Opus(config={ "claude_api_key" : // Your claude api-key}))

24. Anthropic Claude 2.1​

  • Import the Anthropic_Claude_2_1 model from therix.core.inference_models
from therix.core.inference_models import Anthropic_Claude_2_1
  • Add the model to agent configurations using the add method.
.add(Anthropic_Claude_2_1(config={ "claude_api_key" : // Your claude api-key}))

25. Anthropic Claude 3 Haiku​

  • Import the Anthropic_Claude_3_Haiku model from therix.core.inference_models
from therix.core.inference_models import Anthropic_Claude_3_Haiku
  • Add the model to agent configurations using the add method.
.add(Anthropic_Claude_3_Haiku(config={ "claude_api_key" : // Your claude api-key}))

26. Anthropic Claude 3 Sonnet​

  • Import the Anthropic_Claude_3_Sonnet model from therix.core.inference_models
from therix.core.inference_models import Anthropic_Claude_3_Sonnet
  • Add the model to agent configurations using the add method.
.add(Anthropic_Claude_3_Sonnet(config={ "claude_api_key" : // Your claude api-key}))

27. Anthropic Claude 3.5 Sonnet​

  • Import the Anthropic_Claude_3_5_Sonnet model from therix.core.inference_models
from therix.core.inference_models import Anthropic_Claude_3_5_Sonnet
  • Add the model to agent configurations using the add method.
.add(Anthropic_Claude_3_5_Sonnet(config={ "claude_api_key" : // Your claude api-key}))

Example​

agent = Agent(name="Inference Agent Example")
    (agent
    .add(YourInferenceModel(config = {// Keys according to your selected inference model}))
    .add(// Any other configuration you want to add)
    .save())

     
    ans = agent.invoke(question)

In this way you can add your desired inference model to your agent based on your specific use-case.