SFNR LLM

Model Description

<!-- Provide a longer summary of what this model is. -->

• Developed by: Sofanor AI
• Funded by: OpenSkyML
• Model type: text-generation
• Language(s): English, Russian, French
• License: Mit

Model Sources

<!-- Provide the basic links for the model. -->

• Repository: on HF.co
• Demo: on HF.co

How to Get Started with the Model

Use the code below to get started with the model.

1. Run install module command:

   pip install requests
   

2. Paste this code:

   import requests
   
   HF_READ_TOKEN = "hf_token" # Use yor read-token, it is free
   
   API_URL = "https://api-inference.huggingface.co/models/sofanorai/sofanor-7b"
   headers = {"Authorization": f"Bearer {HF_READ_TOKEN}"}
   
   def query(payload):
     response = requests.post(API_URL, headers=headers, json=payload)
     return response.json()
    
   output = query({
   "inputs": "Can you please let us know more details about your ",
   })
   

3. Run with Python:

   python your_file.py
   

Environmental Impact

<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

• Hardware Type: GPU
• Compute Region: USA