Back-end Developer for SMART Proposal Capability Using RAG and Azure

We are looking for a skilled back-end developer with experience in Azure Search and RAG to enhance our consulting firm's SMART proposal creation process. The task involves enhancing Retrieval-Augmented Generation (RAG) through advanced techniques in indexing and search *e.g. hybrid, rankings) query construction, understanding and expansion (dynamic, contextual). and routing to build a system that streamlines the development of consulting proposals. These proposals are tailored documents we present to clients to address their specific needs and pitch consulting projects effectively. Key Requirements *Azure Integration: The solution must utilize Azure AI search, particularly Azure Blob storage, for data management and scalability. *RAG Enhancements: Build upon our existing RAG implementation, incorporating the latest advancements such as ranking, better search precision, indexing, and matching mechanisms to ensure high-quality proposal generation. *SMART Proposal Capability: Automate the creation of consulting proposals, which typically include: Context: Overview of our firm, relevant past projects, and their alignment with the client’s needs. Client Problem Statement: Detailed description of the client's challenges and requirements. Proposed Approach: Comprehensive explanation of our solution, including methodologies, deep dives into specific activities, and example deliverables. Team Details: Profiles of the team members proposed for the project. Costing: Clear and transparent project cost breakdown. Template Utilization and Flexibility: Develop the system to work with our existing templates and eventually evolve to generate proposals independently of pre-designed templates. Deliverables and Milestones Milestone 1: RAG Enhancements and Azure Integration Enhance existing RAG implementation with the latest advancements: Audit Existing System: -Review retrieval methods (e.g., sparse, dense, hybrid).Analyze current ranking and indexing strategies. -Assess generation accuracy and relevance to retrieved content. Define KPIs: -Retrieval precision and recall. -Generation relevance and factuality. -Latency and scalability metrics. Set a Baseline: -Run performance tests using sample queries and evaluate against KPIs. -Iterate with us to identify pain points . Improved search capabilities for retrieving contextually relevant data. Advanced indexing techniques for optimized storage and retrieval. -Contextual Chunking and Retrieval -Query optimization and hybrid search and enhanced ranking algorithms for more accurate matching of relevant information. Set up Azure Blob storage for secure and scalable data storage Milestone 2: Proposal Automation Using Template: Develop the back-end logic to auto-fill our standard proposal template with: Context on our firm and past projects. Client problem statement and detailed needs. Proposed solutions and activities. Milestone 3: Enhanced Proposal Generation Extend functionality to include: Backup approach slides with detailed methodologies, images, and examples. Ensure these are correctly inserted into the predefined proposal template. Milestone 4: Comprehensive Proposal with Investment Options Build upon the previous milestones to: Include proposed team details, roles, and responsibilities. Add options for investment and cost breakdown. Ensure seamless integration into the proposal template. Milestone 5: Full Proposal Creation with Documentation Develop the ability to generate complete proposals from scratch: Include all necessary sections (context, solutions, team, costs, etc.). Provide detailed documentation of steps and processes to replicate the output. Milestone 6: Independent Proposal Creation Finalize the system to create proposals entirely from scratch: Achieve independence from pre-designed templates. Allow full customization for unique client requirements. Ideal Freelancer Profile Technical Expertise: Strong experience in back-end development and working with RAG systems. Azure Proficiency: Proven ability to design, deploy, and optimize solutions on Azure and Azure AI Search, including Blob storage integration. Proposal Automation Experience: Familiarity with automating document generation processes, especially in consulting or related industries. Communication Skills: Ability to document processes clearly and provide regular updates on progress.