Edvantis
Опис
We’re opening the position of Senior Test Automation Engineer (Python) to the
new team in the project of our customers. They provide SAAS solutions that help
companies optimize their businesses. These solutions include business planning
& execution, process automation, and optimization. The Customer’s platform
leverages industry-leading artificial intelligence (AI agents).
In this position, you will be responsible for the AI Agents testing through UI
and API layers.
RESPONSIBILITIES:
* Design, develop, and maintain automated test scripts and frameworks using
Python and Pytest
* Create test strategies for validating AI agent workflows, APIs, and Agent
integrations
* Implement end-to-end, integration, and regression testing for AI agent
solutions
* Integrate test automation into CI/CD pipelines (GitHub Actions)
* Perform manual exploratory testing where automation is not yet feasible
* Build and execute test plans for validating:
— Conversational logic and accuracy of AI agents
— API interactions, data pipelines, and back-end services
— Performance, reliability, and scalability of AI-driven services
REQUIREMENTS:
* 4+ years of experience in QA Automation, with strong hands-on skills
in Python & Pytest
* Experience testing APIs (REST, GraphQL) with tools like Postman/Newman
* Knowledge of CI/CD pipelines and automation integration (GitHub Action would
be a plus)
* Strong debugging, troubleshooting, and problem-solving skills
* Familiarity with performance/load testing tools (Blazemeter, JMeter)
* Excellent written and spoken communication skills
* English level — Upper-Intermediate or higher
WILL BE A PLUS:
* Familiarity with AI/ML testing approaches (e.g., NLP testing, model response
validation, fuzz testing) would be a plus
* Hands-on experience testing AI conversational agents (e.g., OpenAI, Azure
OpenAI, Copilot, Dialogflow, Rasa, LangChain) would be a plus
WE OFFER:
* Remote-first work model with flexible working hours (we provide all
equipment)
* Comfortable and fully equipped offices in Lviv and Rzeszów
* Competitive compensation with regular performance reviews
* 18 paid vacation days per year + all state holidays
* 12 days of paid sick leave per year without a medical certificate + extra
paid leave for blood donation
* Medical insurance with an affordable family coverage option
* Mental health program which includes free and confidential consultations with
a psychologist
* English, German, and Polish language courses
* Corporate subscription to learning platforms, regular meetups and webinars
* Friendly team that values accountability, innovation, teamwork, and customer
satisfaction
* Inclusive environment where everyone feels valued and treated equally.
We proudly partner with VeteranHub to support Ukrainian veterans
* We are committed to supporting Ukraine and actively participate in charity
initiatives
new team in the project of our customers. They provide SAAS solutions that help
companies optimize their businesses. These solutions include business planning
& execution, process automation, and optimization. The Customer’s platform
leverages industry-leading artificial intelligence (AI agents).
In this position, you will be responsible for the AI Agents testing through UI
and API layers.
RESPONSIBILITIES:
* Design, develop, and maintain automated test scripts and frameworks using
Python and Pytest
* Create test strategies for validating AI agent workflows, APIs, and Agent
integrations
* Implement end-to-end, integration, and regression testing for AI agent
solutions
* Integrate test automation into CI/CD pipelines (GitHub Actions)
* Perform manual exploratory testing where automation is not yet feasible
* Build and execute test plans for validating:
— Conversational logic and accuracy of AI agents
— API interactions, data pipelines, and back-end services
— Performance, reliability, and scalability of AI-driven services
REQUIREMENTS:
* 4+ years of experience in QA Automation, with strong hands-on skills
in Python & Pytest
* Experience testing APIs (REST, GraphQL) with tools like Postman/Newman
* Knowledge of CI/CD pipelines and automation integration (GitHub Action would
be a plus)
* Strong debugging, troubleshooting, and problem-solving skills
* Familiarity with performance/load testing tools (Blazemeter, JMeter)
* Excellent written and spoken communication skills
* English level — Upper-Intermediate or higher
WILL BE A PLUS:
* Familiarity with AI/ML testing approaches (e.g., NLP testing, model response
validation, fuzz testing) would be a plus
* Hands-on experience testing AI conversational agents (e.g., OpenAI, Azure
OpenAI, Copilot, Dialogflow, Rasa, LangChain) would be a plus
WE OFFER:
* Remote-first work model with flexible working hours (we provide all
equipment)
* Comfortable and fully equipped offices in Lviv and Rzeszów
* Competitive compensation with regular performance reviews
* 18 paid vacation days per year + all state holidays
* 12 days of paid sick leave per year without a medical certificate + extra
paid leave for blood donation
* Medical insurance with an affordable family coverage option
* Mental health program which includes free and confidential consultations with
a psychologist
* English, German, and Polish language courses
* Corporate subscription to learning platforms, regular meetups and webinars
* Friendly team that values accountability, innovation, teamwork, and customer
satisfaction
* Inclusive environment where everyone feels valued and treated equally.
We proudly partner with VeteranHub to support Ukrainian veterans
* We are committed to supporting Ukraine and actively participate in charity
initiatives