change meddic call to return json response

reports/HSBC Opportunity Review Report.md

@@ -1,26 +1,25 @@
 **Analysis Results**
 
-**Summary:** The opportunity with HSBC involves offering a new analytics engine for their loan origination system, which is currently slow and inflexible. The urgency for decision-making stems from their upcoming renewal with the existing vendor. Multiple meetings have taken place, including an initial discovery call, a technical deep dive, and a proposal review, with HSBC expressing interest in moving forward. The next step involves further discussions with John Smith, the VP of Information Technology, to potentially proceed to a pilot program or final negotiations.
+**Summary:** The opportunity involves replacing HSBC's current analytics system for their loan origination process with our more flexible and faster solution. The decision is time-sensitive due to an impending renewal with their existing vendor, and there has been strong engagement from key stakeholders, including the VP of IT and the CFO.
 
-**Score:** 75
+**Score:** 80
 
 **MEDDIC Evaluation:**
 
-**Metrics:** 80
-**Evaluation:** John Smith appears to be a potential champion, given his active involvement. However, it is uncertain how strongly he advocates for the solution internally or if there are other champions within HSBC. Further development of internal champions may be needed.
-**Economic Buyer:** 70
-**Decision Criteria:** 75
-**Decision Process:** 70
-**Identify Pain:** 85
-**Champion:** 65
+**Metrics:** 7 - The potential ROI and performance improvements were discussed, but specific quantified metrics on cost savings or efficiency gains were not detailed.
+**Economic Buyer:** 8 - The involvement of the CFO in the proposal review suggests access to the economic buyer, but further direct engagement may be needed to solidify alignment.
+**Decision Criteria:** 7 - HSBC is evaluating the proposal based on implementation scenarios and pricing structure, indicating some understanding of their decision criteria, but more clarity is needed.
+**Decision Process:** 8 - HSBC has shown a structured decision-making process with multiple meetings and a review phase, but exact timelines and steps need more definition.
+**Identify Pain:** 9 - The pain point of a slow and inflexible current system is well understood and articulated, with urgency due to contract renewal.
+**Champion:** 8 - John Smith, the VP of IT, has been consistently involved and appears to be a strong advocate, but further validation of his influence in the final decision is necessary.
 
 
 **Next Steps**
 
-Schedule a meeting with John Smith to deepen the understanding of HSBC's decision-making process and to identify additional internal champions. Aim to set the groundwork for a pilot program or final negotiations.
+Schedule a meeting with the CFO to directly address economic concerns and solidify alignment with the economic buyer, ensuring full understanding of the ROI and financial benefits of the proposed solution.
 
 **Talking Points:**
 
-  1. **Reinforce the Value Proposition**: Highlight how the new analytics engine will enhance HSBC's loan origination system by improving speed and flexibility, directly addressing the current pain points
-  2. **Discuss the Timeline and Urgency**: Emphasize the importance of aligning with HSBC's renewal timeline to ensure a smooth transition from their existing vendor, and address any potential roadblocks in the decision-making process
-  3. **Identify and Develop Additional Champions**: Explore who else within HSBC might benefit from or support the new solution, and strategize on how to engage these stakeholders to strengthen internal advocacy
+  1. Highlight the specific ROI and cost savings that HSBC can expect by switching to our analytics system, providing detailed metrics and case studies to illustrate the potential financial impact
+  2. Discuss the clear advantages of our system in terms of flexibility and speed, emphasizing how these improvements directly address HSBC's current pain points and align with their decision criteria
+  3. Outline a clear implementation plan with defined timelines and steps to reassure HSBC of a smooth transition process, addressing any concerns about the decision-making process and renewal urgency

utils_opportunity_review.py

@@ -1,5 +1,6 @@
 import json
 import os
+import re
 from langchain.document_loaders import CSVLoader, PyPDFLoader, Docx2txtLoader
 from langgraph.graph import StateGraph, END
 from langchain.prompts import PromptTemplate
@@ -134,7 +135,8 @@ def agent_2() -> Dict[str, Any]:
 
         Assign an overall opportunity score (1-100) with 100 means that the opportunity is a sure win.
 
-        Provide a Summary of the opportunity.
+        Provide a Summary of the opportunity. There must always be a summary. Ensure the summary is on the 
+        same line as the Summary: title
 
         Evaluate the opportunity based on each MEDDIC criterion and assign a score for each criterion:
         1. Metrics
@@ -168,10 +170,13 @@ def agent_2() -> Dict[str, Any]:
         else:
             raise ValueError(f"Unexpected response type: {type(response)}")
         
+        print(response_content)
         # Parse the response content
         lines = response_content.split('\n')
         summary = next((line.split('Summary:')[1].strip() for line in lines if line.startswith('Summary:')), 'N/A')
+        print(summary)  
         score = next((int(line.split('Score:')[1].strip()) for line in lines if line.startswith('Score:')), 0)
+        print(score)
         meddic_eval = {}
         current_criterion = None
         for line in lines:
@@ -197,6 +202,108 @@ def agent_2() -> Dict[str, Any]:
             'meddic_evaluation': str(e)
         }
     
+def clean_and_parse_json(json_string):
+    # Remove triple backticks and "json" label if present
+    json_string = re.sub(r'^```json\s*', '', json_string)
+    json_string = re.sub(r'\s*```$', '', json_string)
+    
+    # Remove any leading/trailing whitespace
+    json_string = json_string.strip()
+    
+    # Parse the cleaned JSON string
+    try:
+        return json.loads(json_string)
+    except json.JSONDecodeError as e:
+        print(f"Error parsing JSON: {e}")
+        return None
+    
+def agent_2_json() -> Dict[str, Any]:
+    """Agent 2: Evaluate opportunity based on MEDDIC criteria."""
+    try:
+        results = qdrant.scroll(collection_name="opportunities", limit=100)
+        if not results or len(results[0]) == 0:
+            raise ValueError("No documents found in Qdrant")
+
+        full_text = " ".join([point.payload.get("text", "") for point in results[0]])
+        
+        meddic_template = """
+        Analyze the following opportunity information using the MEDDIC sales methodology:
+
+        {opportunity_info}
+
+        Assign an overall opportunity score (1-100) with 100 means that the opportunity is a sure win.
+
+        Provide a Summary of the opportunity. There must always be a summary. Ensure the summary is on the 
+        same line as the Summary: title
+
+        Evaluate the opportunity based on each MEDDIC criterion and assign a score for each criterion:
+        1. Metrics
+        2. Economic Buyer
+        3. Decision Criteria
+        4. Decision Process
+        5. Identify Pain
+        6. Champion
+
+        Your response must be in JSON format.
+        Use the following keys in the JSON:
+        Summary: Opportunity Summary
+        Score: Overall Opportunity Score between 1 to 100 based on MEDDIC criteria
+        Metrics Score: MEDDIC score on Metrics
+        Metrics Evaluation: Evaluation on MEDDIC Metrics criterion
+        Economic Buyer Score: MEDDIC Score on Economic Buyer
+        Economic Buyer Evaluation: Evaluation on MEDDIC Economic Buyer criterion
+        Decision Criteria Score: MEDDIC Score on Decision Criteria
+        Decision Criteria Evaluation: Evaluation on MEDDIC Decision Criteria criterion
+        Decision Process Score: MEDDIC Score on Decision Process
+        Decision Process Evaluation: Evaluation on MEDDIC Decision Process criterion
+        Identify Pain Score: MEDDIC Score on Identify Pain
+        Identify Pain Evaluation: Evaluation on MEDDIC Identify Pain criterion
+        Champion Score: MEDDIC Score on Champion
+        Champion Evaluation: Evaluation on MEDDIC Champion criterion
+        """
+
+        meddic_prompt = PromptTemplate(template=meddic_template, input_variables=["opportunity_info"])
+        meddic_chain = meddic_prompt | llm
+        
+        response = meddic_chain.invoke({"opportunity_info": full_text})
+        
+        if isinstance(response, AIMessage):
+            response_content = response.content
+        elif isinstance(response, str):
+            response_content = response
+        else:
+            raise ValueError(f"Unexpected response type: {type(response)}")
+        
+        print(response_content)
+
+        meddic_data = clean_and_parse_json(response_content)
+        print("jsonified")
+        print(meddic_data)
+        # Create the output structure
+        output = {
+            'summary': meddic_data.get('Summary', 'N/A'),
+            'score': meddic_data.get('Score', 0),
+            'meddic_evaluation': {
+                'Metrics': f"{meddic_data.get('Metrics Score', 'N/A')} - {meddic_data.get('Metrics Evaluation', 'N/A')}",
+                'Economic Buyer': f"{meddic_data.get('Economic Buyer Score', 'N/A')} - {meddic_data.get('Economic Buyer Evaluation', 'N/A')}",
+                'Decision Criteria': f"{meddic_data.get('Decision Criteria Score', 'N/A')} - {meddic_data.get('Decision Criteria Evaluation', 'N/A')}",
+                'Decision Process': f"{meddic_data.get('Decision Process Score', 'N/A')} - {meddic_data.get('Decision Process Evaluation', 'N/A')}",
+                'Identify Pain': f"{meddic_data.get('Identify Pain Score', 'N/A')} - {meddic_data.get('Identify Pain Evaluation', 'N/A')}",
+                'Champion': f"{meddic_data.get('Champion Score', 'N/A')} - {meddic_data.get('Champion Evaluation', 'N/A')}"
+            }
+        }
+        print("output")
+        print(output)
+        return output
+
+    except Exception as e:
+        print(f"Error in agent_2_json: {str(e)}")
+        return {
+            'summary': "Error occurred during evaluation",
+            'score': 0,
+            'meddic_evaluation': str(e)
+        }
+
 def agent_3(meddic_evaluation: Dict[str, Any]) -> Dict[str, Any]:
     """Agent 3: Suggest next best action and talking points."""
     try:
@@ -250,7 +357,7 @@ def process_document(state: State) -> State:
 
 def evaluate_opportunity(state: State) -> State:
     print("Agent 2: Evaluating opportunity...")
-    result = agent_2()
+    result = agent_2_json()
     return State(file_path=state.file_path, document_processed=state.document_processed, opportunity_evaluation=result)
 
 def suggest_next_action(state: State) -> State:

utils_prep.py

@@ -62,11 +62,11 @@ async def prep_opportunities(session_state):
 async def prep_opportunity_analysis():
 
     session_state = cl.user_session.get("session_state", None)
-    opportunity_analysis_message = "Retrieving and Reviewing HSBC Opportunitiy - please wait..."
+    opportunity_analysis_message = "Reviewing HSBC Opportunitiy - please wait..."
     await cl.Message(content=opportunity_analysis_message).send()
     
     if session_state.do_opportunity_analysis:
-        agent_1_message = "*Retrieving and reviewing opportunity data from SalesForce CRM ...*"
+        agent_1_message = "*Retrieving and evaluating opportunity data from SalesForce CRM ...*"
         await cl.Message(content=agent_1_message).send()
         await prep_opportunity_review(session_state)
         report = session_state.opportunity_review_report
@@ -78,11 +78,11 @@ async def prep_opportunity_analysis():
         await asyncio.sleep(2)
 
         if session_state.add_objections_to_analysis:
-            agent_3_message = "*Evaluating opportunity and identifying risks ...*"
+            agent_3_message = "*Evaluating opportunity data and identifying risks ...*"
             await cl.Message(content=agent_3_message).send()
             session_state.objections = await create_objections(session_state)
         else:
-            agent_2_message = "*Evaluating opportunity ...*"
+            agent_2_message = "*Evaluating opportunity data...*"
             await cl.Message(content=agent_2_message).send()
             await asyncio.sleep(1.5)