After Microsoft’s ChatGPT 4-powered Bing chatbot became a hit, Google hurried to release its own AI chatbot, Bard. Soon enough, it turned out that Bard had its flaws.
A perplexed Twitter user, seeking a basic calculation, asked: “If I’m going 8 miles/hour, how many hours will it take for me to go 8 miles?” Bard’s response was far from accurate, as it confidently proclaimed, “12.5 miles.”
This case is just one among many, highlighting that despite the widespread adoption of AI across industries, even some of the mainstream offerings still have a long way to go.
In recent years, AgileEngine’s Data Studio has empowered companies in areas like fintech, media, logistics, and more to build market-ready solutions leveraging machine learning. Interestingly, some of the best lessons learned have emerged from an unexpected source: our own Design Studio’s user research and UX design guidelines.
Here are two sets of best and worst practices that have become integral to our approach when engaging with AI and ML projects. These practices play a pivotal role in ensuring a more accurate market fit and an enhanced end-user experience.
Good practice #1: focusing on user feedback
An iterative, feedback-driven process is central to agile and commonly used in AI projects. Yet, far too many agile projects fail to extend this approach to encompass end-user feedback. In our experience, incorporating UX techniques for user research in addition to stakeholder feedback can be a game-changer, more so when engaging broad, diverse user groups.
But how to collect user feedback without a 100 million user base?
Consider how OpenAI approaches its user testing needs. As of the latest available data, ChatGPT boasts over 100 million users, with the website receiving 1.6 billion visits in June 2023. Despite these numbers, ChatGPT remains in beta, gathering feedback from this substantial user base.

Conduct qualitative user interviews to solicit feedback on the AI model’s performance in terms of user experience.
Some of the must-have questions include:
1) Is the model helpful?
2) Are the results accurate?
3) Given the current experience, would you prefer switching to interacting with a human or using AI to narrow down your requests
Good practice #2: having user controls in place

Fine-tuning tone, voice, and formality instead of the one-size-fits-all approach used by Google could create translations matching the user intent more precisely.

Inclusive language is essential in many contexts. Users could have the option to select gender-neutral translations when referring to individuals. This feature helps users communicate inclusively and avoid potential issues that come with gender-specific language.

Run recorded sessions to observe users as they interact with the AI or perform usability testing to identify UX-related issues.
Bad practice #1: disregarding negative feedback
Issues like model drift are inherent in AI systems, and addressing them involves collecting negative user feedback through UI/UX methods.
Companies like Grammarly, Spotify, and YouTube use various UX strategies to monitor their products continuously. These strategies range from enabling users to easily report incorrect output to allowing them to rate the relevance of suggested recommendations.
The data collected through these channels provides valuable insights to AI engineers. These insights help engineers make necessary adjustments “under the hood” to maintain AI effectiveness and detect biases.
Bad practice #2: sacrificing privacy for personalization
While personalization can enhance user experiences, sacrificing user privacy for customization is a detrimental pattern. Ignoring UX principles of respecting user boundaries and informed consent can lead to a breach of trust, or worse, regulatory compliance issues.
AI systems that collect extensive user data without clear communication and opt-in mechanisms can alienate users and tarnish brand reputation.
What to do about it?
Clearly communicate data collection and usage policies to users
When a user signs up for an AI-powered app, provide a clear and concise pop-up that explains what data will be collected, how it will be used, and who it might be shared with.
Offer granular controls over what data users are comfortable sharing
Controls of this type can take the form of a series of checkboxes that allow users to choose what information they want to share.
Implement robust data protection measures and comply with relevant regulations
For instance, if your app targets European users, implement processes that allow users to request their data to be deleted in compliance with GDPR.
Wrapping this up
By strategically integrating UX principles, companies can navigate the intricacies of AI deployment more easily and adeptly. This synergy helps to enhance user experience, elevate product quality, and increase revenue.
AgileEngine’s Design Studio stands as a beacon of expertise in this endeavor. Our team of
5-star-rated UI/UX experts is poised to assist you in overcoming any challenges at competitive nearshore rates.
Turn data into action
From custom pipelines to performance optimization, visualization, ML & analytics — our data solutions fuel your business growth.
AI Studio
Transform your business and wow users with state-of-the-art Generative AI and ML solutions.
Design Studio
Turn design into a driver of business growth with Lean UX consultancy and UI/UX solutions.
Performance optimization
Maximize efficiency and avoid performance degradation while achieving crystal-clear data.
Featured deliverables
- 12x faster data consumption for an energy efficiency provider to Bank of America, Goodyear, and Gap
- 15x faster data pipelines delivered to a vendor to Gap, Bank of America, and Goodyear
Data engineering
Unify data for analysis and reporting with ETL pipelines, data governance, data quality checks, and monitoring.
Featured deliverables
- Data collection, storage, and warehousing with various data pipelines and systems of insight delivered for a Fintech used by Disney, UberEats, and Chase
- Data pipeline, data lake layers, and database redesign with standardization of data ingestion, transformation, and delivery for a technology consulting firm with 80 offices worldwide
Data visualization
Gain insight into vast amounts of data and drive the business forward.
Featured deliverables
- Design of the language and standard of data description and visualization for the world’s #1 job site
- Full-cycle design and development of a data visualization SaaS featured by Gartner and used by IBM
Data science and machine learning
Turn raw data into actionable information with ML solutions for data collection, organization, summarizing, analysis, and recommendations.
Featured deliverables
- Predictive analytics, NLP, and data engine solutions delivered to Merck, Tesla, and T-Mobile providers
- Driving the evolution of a logistics SaaS used by IBM and Merck from an early prototype to a full-fledged predictive analytics/ML platform
Our data
and analytics services
Explore what we can do for you
Data vendors to Tesla, Wells Fargo, and IBM report up to 15x performance improvements with our solutions
Our process

Define

Measure

Analyze

Improve

Control
Clients rate us 5 stars
See what they say about us

“AgileEngine delivers quality work, much of which can be attributed to their ability to supply such expert resources that fit well with the internal tech stack. They’ve effectively become part of the internal team while providing a good ROI. Responsive and timely, they communicate seamlessly.”
Chris Johnson
CTO, Centriq

“AgileEngine’s developers have adjusted well to the complex software they had little prior experience with. Still, they have performed to a level on par with the in-house developers. They have been eager to learn and contribute, becoming invested in the overall quality of the deliverables.”
Kevin Heidorn
COO, Yobi

“Unlike other providers, AgileEngine offers a competitive price while still doing high-quality work. They focus on building a successful product and not just on getting paid, which fosters a positive working relationship. The team communicates well and is open to changes in project scope.”
Igor Minin
VP of Engineering, iControl

“AgileEngine built a quality product, overcoming communication challenges and several fluctuations in staff. Their CEO’s strong leadership and desire to exceed expectations helps them stand out among other vendors, although clearly defining project ownership is recommended for future endeavors.”
Doug Ramsay
Former Director of Engineering, Livingsocial
“AgileEngine works with us as a close partner, essentially an extension of our internal teams. I have no suggestions for improvement, except possibly cloning our AgileEngine team so we can have more of them.”
VP, Entertainment Company
Our clients win.
You can do it, too.
Why choose our
Data Studio

10+
years in the game
Top-1% talent
across 4 continents
High efficiency
In-house quality, skills, and industry expertise at a fraction of in-house costs
Proven expertise
We are consistently rated 5 stars and loved by 200+ clients
Scalability efficiency
Get the right capabilities at every stage of your growth, we’ll handle the details
Custom approach
No cookie-cutter tech — solutions adapt to your business, not the other way around
Data solutions
featured by industry leaders


Our engineers are well-versed in 150+ technologies
Get more information about our expertise in your tech stack and industry