Integrating Agentic AI with Existing Machine Learning Pipelines

Integrating Agentic AI with Existing Machine Learning Pipelines

In this article, you will learn how to combine a classical machine learning pipeline with an agentic AI system to build a hybrid, autonomous customer retention workflow. Topics we will cover include: How to generate a synthetic dataset and train a random forest classifier for customer churn prediction using scikit-learn. How to design an agentic AI system — complete with tools and an LLM-powered reasoning core — that interprets machine learning predictions and acts on them autonomously. How to wire the machine learning pipeline and the agent together into a single, end-to-end runnable Python application. Introduction Agentic AI and machine learning pipelines are far from incompatible when it comes to building production-ready AI applications. In fact, embracing them as two sides of the same coin has become more than a mere trend: it constitutes a modern foundational architecture pattern that drives the shift from passive predictive analytics to autonomous decision-making and action. Traditional machine learning pipelines excel at pattern recognition tasks of varying complexity, but they are purely reactive in their base form. Meanwhile, agentic AI systems are all about proactivity: combined with predictive machine learning models, they can build on the insights yielded by such models to plan, use tools, and address real-world use cases with little or no human guidance. In this hands-on article, we will show you how to bridge the gap between reactive machine learning models and proactive AI agents. We will construct a lightweight, free, runnable Python pipeline that: Predicts customer churn based on a classical machine learning model built with scikit-learn. Hands the obtained predictions over to an agent endowed with a state-of-the-art LLM to autonomously reason and execute different customer retention strategies. Prerequisites The entire coding tutorial can be run for free in Google Colab or a local Jupyter notebook, provided you have the necessary libraries installed and imported. If you are using Colab, at the time of writing, the only library you might need to manually install is Groq: Make sure you also import the following: import numpy as npfrom sklearn.ensemble import RandomForestClassifierfrom sklearn.model_selection import train_test_splitfrom groq import Groq Since Groq — one of today’s most capable open-source LLM providers — requires an API key, be sure to register on their website and create your own API key here. You will need to incorporate it in your notebook or Google Colab account. The code below is designed to read the API key from the “Secrets” section found on the left-hand sidebar in Google Colab: create a new secret variable there called GROQ_API_KEY, and paste your actual Groq API key into the “value” field. These instructions will help you inject the newly added API key into your program: import osfrom google.colab import userdata# Injecting the Colab secret into standard environment variablesos.environ["GROQ_API_KEY"] = userdata.get('GROQ_API_KEY') Step-by-Step Guide Once the prerequisites are set up, we will start building the classical machine learning pipeline — for customer churn prediction — that will later be extended by incorporating agentic AI principles and tools. First, we need a customers dataset to feed to our machine learning model. For this example, we will synthetically generate our own dataset containing 500 customers, each described by two predictor features plus a target variable indicating whether the customer is prone to churn. The two input features are the monthly customer spend and the number of support tickets issued by the customer: both are real-world predictors of a customer’s willingness to stay with or abandon a brand. Notice that the code uses numpy functions to introduce random noise, making the artificially generated data look realistic: 1234567891011121314151617181920212223 # ==========================================# 0. SYNTHETIC DATASET GENERATION# ==========================================# Generating a realistic dataset of 500 customers described by two input featuresnp.random.seed(42)n_samples = 500# Feature 1: Monthly customer's spend (uniformly distributed between $10 and $150)spend = np.random.uniform(10, 150, n_samples)# Feature 2: Support tickets issued by customer (Poisson distribution, averaging 1.5 tickets)tickets = np.random.poisson(lam=1.5, size=n_samples)# Generate target variable / Binary class (Churn): # Churn risk increases with more tickets and decreases with higher spendbase_churn_risk = (tickets * 0.15) + np.where(spend 100, 0.2, 0)# Add some random noise to make the dataset realisticbase_churn_risk += np.random.normal(0, 0.1, n_samples)base_churn_risk = np.clip(base_churn_risk, 0, 1)# 0 = Retain, 1 = Churn (Threshold at 0.5)y = (base_churn_risk > 0.5).astype(int)X = np.column_stack((spend, tickets)) Next, we build a simple, classical machine learning pipeline by splitting the dataset into training and test sets and training a random forest ensemble classifier. We verify the model’s performance on the test set before continuing: # ==========================================# 1. CLASSIC ML PIPELINE (Predictive -> Classification)# ==========================================# Train/Test SplitX_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42)# Train the predictive classifier on the larger datasetprint(f"Training ML Model on {len(X_train)} records...")ml_model = RandomForestClassifier(n_estimators=50, max_depth=5, random_state=42)ml_model.fit(X_train, y_train)print(f"Model Accuracy on Test Set: {ml_model.score(X_test, y_test)*100:.1f}%\n") Prediction results on the test data: Training ML Model on 400 records...Model Accuracy on Test Set: 91.0% A 91% accuracy is good enough for our purposes, so we will proceed to incorporating our agent into the loop. The first aspect we will create for our agent is its “hands” — in other words, the tools the agent can use to perform specific actions as a result of its reasoning and decision-making. While in real-world settings these tools typically interact with external components, services, and databases via API calls or similar protocols, we mock two customer-oriented actions here using simple printed messages: # ==========================================# 2. THE TOOLS (Agentic "Hands")# ==========================================# These are two functions the agent will be allowed to trigger in the real world.# Actions are mocked and emulated by using parameterized print messagesdef send_discount(customer_id): return f"[Action Executed] Sent a 20% discount code to Customer {customer_id}."def schedule_support_call(customer_id): return f"[Action Executed] Escalated Customer {customer_id} to a human agent for a check-in." While having the agent call its accessible tools is how it exerts impact once deployed, it is the cognition core — responsible for the agent’s reasoning and execution — where the actual “intelligence” takes place: 1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162 # ==========================================# 3. THE AGENT'S COGNITION (Reasoning & Execution)# ==========================================class RetentionAgent: def __init__(self): print("Connecting to Groq API (Llama 3.3 70B)...\n") # Automatically picks up the GROQ_API_KEY environment variable self.client = Groq() self.model_name = "llama-3.3-70b-versatile" def _reason(self, prompt): # We use the standard Chat Completions API chat_completion = self.client.chat.completions.create( messages=[ { "role": "system", "content": "You are an autonomous customer retention agent. You must output exactly one word: either 'call' or 'discount'." }, { "role": "user", "content": prompt } ], model=self.model_name, temperature=0.0, # Zero temperature ensures deterministic, logical choices ) return chat_completion.choices[0].message.content.strip().lower() def process_customer(self, customer_id, features): print(f"--- Processing Customer {customer_id} ---") # Step A: Getting the prediction from the classic ML pipeline churn_prob = ml_model.predict_proba([features])[0][1] spend_val, tickets_val = features print(f"ML Prediction: {churn_prob*100:.0f}% churn risk.") # Step B: Autonomous Guardrail - only act if the risk is high if churn_prob Model might predict low/moderate risk. # If high risk, agent should pick discount.print(agent.process_customer(customer_id=101, features=[25.50, 1]))# Test Case 2: Moderate spend, high tickets -> Model predicts high risk, Agent should schedule call.print(agent.process_customer(customer_id=102, features=[45.00, 5]))# Test Case 3: High spend, zero tickets -> Model predicts very low risk, Agent bypasses.print(agent.process_customer(customer_id=103, features=[140.00, 0])) Output: Connecting to Groq API (Llama 3.3 70B)...--- Processing Customer 101 ---ML Prediction: 57% churn risk.Agent Reasoning output: 'discount'[Action Executed] Sent a 20% discount code to Customer 101.--- Processing Customer 102 ---ML Prediction: 88% churn risk.Agent Reasoning output: 'call'[Action Executed] Escalated Customer 102 to a human agent for a check-in.--- Processing Customer 103 ---ML Prediction: 0% churn risk.Agent Decision: No action needed. Customer is low risk. The results align with what one would expect. That said, be aware that the model choice matters: we selected an LLM that is well-suited to this task and set its temperature to zero to prevent non-deterministic behavior, which is undesirable in this context. If you choose a different model, your results may vary. Closing Remarks In this article, we built a hybrid pipeline step by step that combines classical machine learning for customer churn prediction with an agentic AI solution capable of turning those predictions into an autonomous reasoning, decision-making, and action workflow. This demonstrates how to bridge the gap between two key pillars of modern AI solutions in corporate and organizational environments. No comments yet.

Original Source

Read the full article at Machinelearningmastery →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.