LLMOps Using Azure Machine Learning Prompt Flow — NER Task

Join me learning Advanced Named Entity Recognition (NER) with Large Language Models (LLMs)

Korkrid Kyle Akepanidtaworn
8 min readFeb 8, 2024

Announcing General Availability of Prompt Flow

During Microsoft Ignite 2023, Prompt Flow, now generally available in Azure Machine Learning and in public preview in Azure AI Studio, is a tool designed for LLMOps at enterprise scale. It supports version-control and collaboration through any source code management tool. Thanks to the valuable feedback from our community, we have added many features to prompt flow since it was first launched in May. With prompt flow, you can now manage different versions of your flow assets such as prompts, code, configurations, and environments through a code repository, and easily track changes and revert to previous versions when needed. Integration with CI/CD pipelines automates tasks like connection setup, prompt tuning, flow evaluation, and experimentation, helping to simplify processes. Prompt flow also makes it easier to evaluate LLM flows for quality and safety, so organizations can get their applications into production with higher confidence.

As an AI engineer, you are familiar with the concepts of MLOps. LLMOps (Large language model operations) falls within the scope of…

--

--

Korkrid Kyle Akepanidtaworn

AI Specialized CSA @ Microsoft | Enterprise AI, GenAI, LLM, LLamaIndex, ML | GenAITechLab Fellow, MScFE at WorldQuant, MSDS at CU Boulder