Logo ANEXIA Internetdienstleistungs GmbH

AI/ML Engineer - LLM Systems

New

Job

  • Level
    Experienced
  • Job Field
    IT, Data, DevOps
  • Employment Type
    Full Time
  • Contract Type
    Permanent employment
  • Salary
    from 54.000 € Gross/Year
  • Location
    Graz, Vienna, Pörtschach am Wörther See
  • Working Model
    Full Remote, Hybrid, Onsite
  • Job Summary

    In this role, you develop LLMs and agentic applications, implement AI solutions using modern frameworks, optimize ML pipelines, and integrate AI functions into production systems.

    Job Technologies

    Your role in the team

    • You drive the development and deployment of AI/ML systems, with a particular focus on Large Language Models (LLMs) and intelligent agent frameworks.
    • You implement and operate LLM inference solutions with runtimes such as Ollama, vLLM, and TensorRT-LLM.
    • You develop agent-based applications using frameworks such as Dify, LangFlow, Haystack, LlamaIndex, LangChain, LangGraph, or Pydantic AI.
    • You integrate AI functionalities from various providers (such as OpenAI, Anthropic, Groq, and Cerebras) into production systems.
    • You implement LLMOps practices with tools like LangFuse and LangSmith for monitoring, tracing, and observability.
    • You develop and optimize ML pipelines using Python, TensorFlow, PyTorch, and scikit-learn for various AI applications.
    • You containerize and deploy AI applications with Docker and Podman.
    • You work with SQL databases and implement evaluation frameworks such as DeepEval to ensure model quality.
    • You work closely with cross-functional teams and continuously present and improve your AI solutions.

    This text has been machine translated. Show original

    Our expectations of you

    Qualifications

    • Knowledge of LLM inference runtimes such as Ollama, vLLM, or TensorRT-LLM.
    • Solid knowledge of SQL and database operations.
    • Understanding of LLMOps practices and methods for model evaluation.
    • Knowledge of DevOps practices (Ansible) is a plus.
    • Excellent written and spoken proficiency in German and English.

    Experience

    • Experience with RAG (Retrieval-Augmented Generation), Prompt Engineering, or Multi-Agent Systems is highly advantageous.
    • In-depth understanding of Large Language Models and experience with the HuggingFace ecosystem.
    • Practical experience with at least one agentic framework (LangChain, LangGraph, Haystack, LlamaIndex, Dify, LangFlow, or Pydantic AI).
    • Experience with Python and modern ML frameworks (TensorFlow, PyTorch, scikit-learn).
    • Experience with LLM APIs (OpenAI, Anthropic, or similar providers).
    • Experience with containerization (Docker/Podman) and orchestration tools.
    • Experience with version control systems and CI/CD tools is an advantage.

    This text has been machine translated. Show original

    Benefits

    Work-Life-Integration

    More net

    Food & Drink

    Health, Fitness & Fun

    Job Locations

    Map of company locations
    • Location Pörtschach am Wörther See

      9210 Kärnten

      Austria

    • Location Graz

      Steiermark

      Austria

    • Location Vienna

      Austria

    Topics that you deal with on the job

    This is your employer

    ANEXIA Internetdienstleistungs GmbH

    ANEXIA Internetdienstleistungs GmbH

    Klagenfurt Am Wörthersee, Graz, Wien

    Anexia was founded by Alexander Windbichler in Klagenfurt, Austria in 2006. The IT service provider offers high-quality and individual solutions in the area of cloud hosting and managed hosting as well as custom software development and app development.

    Description

  • Company Size
    50-249 Employees
  • Founding year
    2006
  • Company Type
    Digital Agency
  • Working Model
    Full Remote, Hybrid, Onsite
  • Industry
    Internet, IT, Telecommunication
  • Dev Reviews

    by devworkplaces.com

    Total

    (2 Reviews)
    4.0
    • Career Growth

      4.0
    • Culture

      4.0
    • Engineering

      3.2
    • Workingconditions

      4.8
    All Dev Reviews on devworkplaces.com
    Logo ANEXIA Internetdienstleistungs GmbH

    AI/ML Engineer - LLM Systems

    Salary
    from 54.000 € Gross/Year
    Location
    Graz, Vienna, Pörtschach am Wörther See
    Working Model
    Full Remote, Hybrid, Onsite

    More Jobs