Testing

Fourth and final post in this series about a WhatsApp lead-qualification agent we built at a CRM for small businesses. The engine (Postgres and Celery durable runs), the loop (debounce, polling, exits), and the LLM layer (structured extraction, cost metering, injection defenses) are the first three posts. This one answers the question every engineer asks about agent work, usually first: how do you eval it? The honest answer: our v0 is about 90 lines of framework, four scripted scenarios, a staff-only page, and a human doing the judging. No scoring pipeline, no LLM-as-judge, no eval database. This post is why that is a design and not a shortcut, and why we skipped the eval packages we had already shortlisted. ...

PyAutoGUI is one of the framework you can use to test desktop applications. Consider a case where you need to test a flow of the application and it is not in browser, you can go for PyAutoGUI. Selenium is another framework that comes to the mind when we talk about any type of testing automation but it only supports browser based automation. Selenium can not have control over locally running non-browser app. ...

Today, let’s talk about AWESOME X virtual frame buffer. Virtual memory to render GUI If you want to emulate the X server and want your UI apps to render over there then the answer is Xvfb . Xvfb uses frame buffer to emulate X server. Let’s install it first sudo apt update sudo apt install xvfb Basic Usage: Xvfb :111 -screen 0 1920x1080x24 & echo $! > /tmp/runxvfb.pid With this command we are creating a new display with 1920x1080 resolution and put the PID info /tmp/runxvfb.pid “:111” is the ID of the new display. We will use “:111” whenever we want to refer to that display. ...