Beehyv Software Solutions
Established a framework-agnostic behaviour evaluation system for agents and skills with Langfuse tracing, specialized evaluators and ADO pipeline integration, grading each run on seven dimensions with LLM-as-judge and static graders, cutting manual agent testing by 80%.
Owned production skill-based retail product-listing agents end to end for an enterprise CPG customer, cutting run latency 3x through measured prompt and context-compaction ablations and raising success rates from ~64% to 87-98% with a cron-based reliability harness, error taxonomy and CSV chunking strategies that return partial output on step failure.
Architected Plan and Execute orchestration framework enabling multi-agent coordination for complex user requests, with support for human-in-the-loop interrupts, dynamic replanning with validation feedback and flexible iteration strategies for long-running LLM workflows.
Built CSV bulk processing workflow achieving high reliability for thousands of records through optimized batching, retry logic, milestone tracking and structured output validation.
Added integrations for Digital Asset Management platforms (e.g., OneDrive, Google Drive) to store assets generated using generative AI. Connected Email Marketing platforms (e.g., Mailchimp, Klaviyo) to automate email campaigns with AI-generated HTML content using Workato recipes.
Blueflagsecurity.com integrating connectors for various source control platforms like GitHub, Bitbucket to monitor and get insights about security risks.