Skip to content

LLM - Completion

Install packages

1
2
3
!uv pip install -q \
    litellm==1.78.5 \
    python-dotenv==1.1.1

Import packages

1
2
3
4
import litellm
from dotenv import load_dotenv

load_dotenv()

True

Define messages

  • System message, defined once
  • User messages
1
2
3
4
5
6
7
messages = [
    {"role": "system", "content": "You're a helpful assistant."},
    {
        "role": "user",
        "content": "Write a limerick about the Python programming language.",
    },
]

Get chat completion

1
2
3
4
5
6
7
completion = litellm.completion(
    model="gemini/gemini-2.0-flash",
    messages=messages,
)

response = completion.choices[0].message.content
print(response)

There once was a coder named Sue,

Whose programs in Python all flew.

With syntax so neat,

And libraries sweet,

Her projects were simple and new.