joined @LangChain almost three months ago and have spent a ton of time thinking about evals! i think that harbor is the future of eval frameworks so really enjoyed being able to bring it into tighter integration with our stack!!
http://x.com/i/article/2069807654986276864
Users praise the Harbor integration with LangChain for adding deterministic checks that catch subtle behavioral drift before production.
No Digg Deeper questions have been answered for this story yet.
harbor is a great framework for running evals for long running, stateful agents
its becoming industry standard, powering benchmarks like terminal bench 2
we've integrated deeply with harbor: across LangSmith, Sandboxes, and Deep Agents
http://x.com/i/article/2069807654986276864
@LangChain @harborframework deterministic checks change the game for regression testing - finally a way to catch subtle behavioral drift before production
.@harborframework can now integrate directly with Deep Agents, LangSmith Sandboxes, and LangSmith Observability.
You need to run agents in a real, reproducible, isolated environment, many times in parallel, with a deterministic check at the end.
Harbor solves this problem.
Everything you need to know⤵️
http://x.com/i/article/2069807654986276864
@LangChain @hwchase17 @harborframework what tools would you recommend for people who want to go into ai application engineering, GenAi engineering and ai engineering?
@nana_tourSVT @LangChain @harborframework building eval pipelines is one thing, but maintaining them at scale is where most teams struggle - any tips?