Introducing Etiq 2.0

Research has shown that 91% of all ML models will degrade over time, and Data Scientists spend over 45% of their time dealing with issues and debugging. We are delighted to announce the launch of our newest version of our software, Etiq 2.0, built to drastically reduce the time it takes to debug, whilst rapidly increasing the up-time for your ML pipelines.

Bringing together our rich heritage in testing, with new innovations in how Data Scientists and Machine Learning Engineers visualise and interact with code and how you can take test failures further to exactly pinpointing errors and providing fixes.

Data and Code Lineage

Speaking to Data Scientists we've heard time and again the problems of navigating and understanding increasingly long and complex code bases. From having to update legacy pipelines to creating new innovations, the core understanding of what is your data, what is your code, and how they interact throughout the lifetime of a script is key to success as a Data Scientist.

Lineage from Etiq is here to solve that, by scanning your script and providing a visual representation of the logical flow of your script you can understand what is happening like never before. Being able to trace your data from ingest, to feature generation, to modelling you can see where each object has come from and how it's being interacted with. Never get lost again playing needle in the haystack with your pipeline, Lineage makes visible the invisible.

Testing Recommendations

Etiq know testing. We understand that in order to keep ML pipelines running when they hit the real-world you need to design them to be robust to changes in the data. The right tests, in the right place are key to doing that. But having spoken to numerous Data Scientists and teams we know that often that doesn't happen. Either through not knowing what tests to add and where, or not having the time to add tests before getting something into production. We know testing isn't glamorous work, but it's the difference between broken pipelines and constant debugging, or time spent building new and improved models. Data Scientists doing what they do best.

Our testing recommendation engine sits in Etiq, built with decades of lived experience from hands-on Data Scientists, it takes the information from your lineage and recommends not only the right test for your script but also where you should put them. Testing recommendations ensure you can stop hoping and start knowing how to create pipelines that last.

RCA Agents

We've all seen them, we've all had them, alerts are there to tell you there's an issue. But that is just the start of the journey, knowing there's something wrong is one thing, fixing it is another. Alerts will tell you there's a problem, it's down to you to find that needle in the haystack.

RCA Agents from Etiq, are designed to change that. When you have a test fail, our RCA agents have been built to know how to resolve that issue. Taking all the information from your lineage, the status of the data, the code, how that evolves over time, and the nature of the test failure, they can navigate through the lineage identifying where the problem first arose. Once that is done through analysis of the entire network they can then suggest a fix, based on encoded expert knowledge from our team of Data Scientists, that will resolve the issue. No more searching for answers, pinpointing the root of the issue and providing an appropriate fix. Debugging effortlessly.

With you where you work

We've all seen the promise of new tools and software. They can revitalise how you work. They can provide incredible efficiencies. They can make your job easier, faster, better. However they always come with a new system to learn, a new platform to discover, new ways of working. If you just do things their way, those amazing promises will be delivered.

At Etiq we don't promise that, we spoke to Data Scientists to really understand how you work and how you want to work. We don't ask you to change. Write your code how you want and where you want, Etiq will be with you where that happens. Our software sits right inside your development environment, working with code that you've written. No changes needed, no new systems or platforms. Your script, your innovations, are the star of the show. Etiq sits alongside you giving you support to ensure that the hard work you put into building models and pipelines isn't wasted. It's where you need it.

This is just the start

We're so incredibly excited to release the new Etiq into the world. With compatibility for Python scripts and our incredible VSCode extension, we believe that the act of taking code from discovery, to development, to productionisation should feel effortless. You just need the right tools, in the right place, doing the right thing for Data Scientists. We've got even more innovations coming on our roadmap, we're only just getting started.