← BACK TO PROFILES

Dhwani Soni

Global Vice President of Product Management, Design and Operations·8x8·San Francisco Bay Area, California·

AI made execution faster, but judgment still relies on a human being

In this interview

Dhwani Soni, GVP Product and Design at 8x8, has watched AI split product work in two: execution got faster, and judgment didn’t. Prototypes and demos now arrive in days. Customer trust, audits and compliance still move at their old speed, so she argues product leaders have to slow down before they put anything AI-built in front of a customer. She explains why companies still owe junior talent real on-the-job experience, why teaching and mentoring are different skills, how measuring customer outcomes changes the operating model, and why a backup plan is a reasonable response to a technology that will arrive before society agrees on it. Her test for trusting AI is simple: verify it on repetitive work first, and keep the final decision with a person.

Dhwani Soni
Dhwani Soni, Global Vice President of Product Management, Design and Operations at 8x8.

Dhwani Soni is Global Vice President of Product Management, Design and Operations at 8x8, where she owns portfolio strategy across the company's UCaaS, CCaaS, CPaaS, CX, analytics, AI, and platform products and leads its product management, design, user research, and product operations teams. She describes her work as sitting at the intersection of product, technology, and human behavior.

Dhwani joined 8x8 in 2019 to lead product management and user experience design, and has since launched the 8x8 Engage product line and led the evolution of its conversation analytics into the AI-native 8x8 Pulse. Before 8x8, she spent five years building the user experience organization at MobileIron, after design roles at SAP, Dell Services, and Samsung Electronics.

“Technology and science will happen before society reaches consensus. That is inevitable. And at that point, as companies and as leaders, our responsibility is to do our best to make sure it happens rightly for society.”

Dhwani's core argument is that AI has compressed execution but not judgment. Prototypes and demos now arrive in days, but customer trust, compliance, and real outcomes still take time, so product leaders have to slow down before making promises, measure what customers actually gain, and keep investing in the junior talent AI tempts companies to skip.

"Just because AI has made quantity possible, the judgment still relies on a human being," Dhwani explains. "What should be built? Why should that be built?"

The conversation

In this conversation: Josh Rubin (Host, CTO Studio) and Dhwani Soni (Global Vice President of Product Management, Design and Operations, 8x8).

Recorded in San Francisco for the CTO Studio interview series. Interview recorded on 09/04/26.

This interview was recorded by CTO Studio, a media brand owned by Howdy (howdy.com). Transcript lightly edited for clarity.

Dhwani Soni

I am GVP of Product Management and Design at 8x8, and I work at the intersection of product, technology and human behavior.

Josh Rubin

This has become a product world in a way it was not before. You've been doing this a while. How are you feeling about this AI transition? All of the news, all of the changes. Nobody's job and role has been more impacted by this than yours.

Dhwani Soni

Personally, I thrive in transformation, so it's exciting. I'm enjoying the bit where human behavior is coming to the forefront, with technology tapping into it in so many different ways that it's becoming ever more important to understand behavior and how we work through that. How am I feeling? As a leader in an organization, there's even more responsibility. There's greatness with AI: now you have sufficient evidence around things that you can see and measure, which before AI wasn't possible as much. Making sure we have enough evidence, and how much is enough or sufficient, is the judgment call that we as leaders have to make. But it comes with a responsibility. Just because AI has made quantity possible, the judgment still relies on a human being. What should be built? Why should that be built? How is it impacting a customer's outcome? And why would a customer trust you as a company versus company B? That's where we as product leaders have a sincere responsibility. And there are so many other things, not just this. Talent is getting compressed. Junior talent is being replaced by agents. Why? Because managers just can't keep up. They're asking, should I train a junior person or should I just give it to an agent to build it? So there are so many different things happening, and how we take responsibility to deliver AI responsibly, as a company and as individuals, starts to show up in our leadership.

Josh Rubin

Product people, and frankly me as a journalist and a TV guy, chaos is where I live. I like a little bit of chaos. I see chaos and I say, oh, this looks like fun. I think product people have a similar mindset. But one thing that's also part of thriving in chaos is the ability to do short-term tactical thinking. I cannot plan everything, but what can I plan for right now? When you're talking about junior engineers, that kind of thinking, do I train this junior engineer or do I just give it to an AI agent, is short-term thinking. There are downstream consequences for any organization that follows that. It can't be chaos all the time. You have to be able to code-switch into medium-term and long-term planning. So how are you dealing with that right now?

Dhwani Soni

Personally, I think we owe it to the next generation to make sure we have comprehensive programs, by companies or academically, where we sustain and support them growing up. We all know that what you learn academically is not the same as when you get into a company and apply those skills. You still need to understand the industry. You still need to understand how that company behaves. That's where we owe it to them. Programs like internships, apprenticeships and rotational programs are still extremely valuable to provide to the next generation. Those opportunities cannot be wiped away with AI, even if we tell them to build those agents. Having on-the-job experience should not be taken away by AI.

Josh Rubin

Everybody likes to mentor. Not everybody was meant to teach.

Dhwani Soni

Agreed. But I think mentorship is different from teaching. Both are different skills.

Josh Rubin

Tease that out a little bit. What do you see as the difference there?

Dhwani Soni

When you're teaching, you are providing your principles and mindsets. As a teacher, you have different skills to manage a crowd, and you bring that storytelling ability to transfer a skill. Mentorship is slightly different. Mentorship is where you bring your own stories to a problem that a person is having, and have them live through a moment of, yes, this is possible if I change my perspective. So I think those are different skills.

Josh Rubin

If I'm understanding correctly, giving them the tools and telling them the story is teaching. Providing the example and being the person they want to grow up to become is mentorship. If you're good. Otherwise it becomes performing.

Dhwani Soni

You're absolutely right. Not everybody is cut out to be a teacher. Not everybody is cut out to be a mentor. I'm not cut out to be a teacher. I don't have that level of patience. But one-on-one mentorship, yes, I can, and I do. I believe in paying that forward.

Josh Rubin

Let's back up a little bit. If you had to boil down what you do, what is it?

Dhwani Soni

I look for signal through the noise and tie it, like you said, tactically, to what we are trying to solve, and then try to connect that.

Josh Rubin

So you do pattern recognition professionally, which is what AI is built to do at scale. That's why I think you can look at it and recognize, oh, it's doing this thing I used to do, and I can't do it at that scale. But you can also look at it and say, well, it's wrong. It recognized the pattern incorrectly. That's where judgment comes in. The fear I have is that judgment is born out of a lifetime of experience, out of 20 years of working on problems before AI could do the pattern recognition. Have you noticed times when you've been using these tools that you've gotten lazy? The worst is when I ask it a question and it comes up with a really good line, and I think, I could have come up with that line if I had a little bit more time. It's the intellectual laziness I worry about.

Dhwani Soni

AI may not be new as a technology, but it's new in the hands of so many people, and the things you can produce with it are so compelling at times. Think about compelling demos, vibe-coded stuff, the content you just mentioned. I could have come up with that statement if I had more time. That lets people jump very quickly: let's do it, let's produce it, let's take it in front of the customer. Then you start to build a relationship with the thing you just produced, and then there are commitments from customers. So I think there's a moment to slow it down. Think about the gates that existed pre-AI: when a product is ready for a prototype, when you take it to a customer for research, how long it takes to productize. Execution has definitely compressed. But the time it takes to nurture that relationship, and the time it takes to work through the bureaucracy of audits and compliance to really productize something in the hands of a customer in a specific industry, those haven't accelerated yet. So we need to slow down and say, okay, we have something. Before we take it to the customer, let's make sure we set the expectation correctly.

Josh Rubin

I talk about this all the time with people in the CTO class. Coding has obviously gotten faster, but the bottleneck has moved. This sounds like where the bottleneck has moved in product. Prototyping and MVPs are crazy fast at this point, and then you can really spend time with the customer doing the important bit, which is the back and forth. You've had maybe a year with these new prototyping and iterative engagements. Talk me through how the product environment has changed for you, what benefits you're seeing, and what you don't like about it.

Dhwani Soni

I can answer it from the product side or from the operating model side.

Josh Rubin

Both are interesting. Let's start from the operating model side.

Dhwani Soni

If you think about the operating model pre-AI and post-AI, at the end of the day, what is an organization trying to do? It's trying to make money and stay relevant. How do you do that? By delivering meaningful customer outcomes. Because AI has compressed the time to code, you now spend more time connecting with the customer on their outcomes and defining those outcomes. You can only get ROI from AI if you can measure it, and AI has made that possible today. AI also makes it possible to use mathematical models at scale to figure out how to measure that. Now you can apply that to the operating model overall. If your end goal is supporting a customer's outcome, or the top-line P&L for your company, you work backwards. Things that were previously execution-focused were very manual. Think about how a product progresses from research to MVP to prototype, through the different gates: beta program, alpha program, content, tech writing, taking it to the customer, demoing internally, building that environment, and eventually solving for the customer's outcome. All of that can be generated with AI today. You can apply that lens from a factory-model perspective and automate all of it. Then you know very quickly where your outcome is stuck for the customer. Your context layer is built, your data layer is comprehensive, and you're running AI on top of it. I literally think of it as a light bulb moving around the London Tube map. That's you as a company, and where you are in delivering that outcome for that customer. And you can measure that today. We've gotten to KPIs that existed before but you could never measure. Think about organization-wide promise tracking for a customer: how many people in my organization committed so many different things to so many customers, and how have I scaled as a company to deliver them? AI can measure that today, if your data is connected, your layers are clean and there's not too much garbage in. And when you can measure it, you can put an ROI on top of it. Operating models used to be more factory-oriented: I am releasing this, and the next stage is adoption. Great, but today that's just a leading indicator. How are you fixing the customer's problem and the outcome they're chasing? That's where you spend the majority of your time now, with the quick early prototyping and vibe coding. And that's where the whole industry is shifting toward a more service-focused model with AI. That's where it has real value.

Josh Rubin

You hope that has real value. Because ultimately, what you just described, we don't know yet. The anxiety born out of all of this is: we hope this is the outcome, but we haven't been in this long enough to gather the data to see that, yes, it is.

Dhwani Soni

I won't dismiss that, because it's very new. But I also believe data will never be enough. Human judgment is what decides what is sufficient. We have so much data: financial and commercial data, CRM data, interaction data from recordings of how you work with customers, telemetry on how they use your product, and what people outside your company are saying about it. You can pull in all of that voice of the customer to understand the gaps and what they're trying to do. You will use AI to apply that judgment, but that judgment is definitely biased by whoever wrote the code. With AI, the asks are very easy. Help me optimize my cost. Help me get ROI on this thing. I got budget approval from my organization; can you help me scale my AI transformation journey? And you sit down with them and understand what that journey means for them. So yes, it's still early. Sufficient data, maybe, but not enough data. I think we're getting very philosophical.

Josh Rubin

It always does, and that's actually where we should be right now. Philosophy is the art of humans ascribing value to things they don't necessarily understand and need to think through. We don't know the answer yet, so we have to think through it. It's very easy to fall into a hype cycle, and it's very easy to fall into doom. Bernie Sanders wants to ban all AI development moving forward. He's 117 years old. He doesn't understand the benefits or what the downstream effects of that would be. Sam Altman thinks we should be injecting this into our brains. I don't think that's a good vibe either. The truth is always somewhere in the middle. We've never had more information, opinions and ideas coming at us in history, and humans were never built to take in all of this at once. Product people are the closest example we have of pattern-matching machines, the people who can look at society and say the vibe here is good or the vibe here is off. From your pattern recognition, what are the vibes right now?

Dhwani Soni

I won't be able to describe it better than you did. There's a part of society that is trying to understand and just keep up, and it's exhausting. There's a part that is against it because it's not environmentally friendly. And there's a part that says you cannot ignore that this is going to happen. I think there's truth in all of them. Technology and science will happen before society reaches consensus. That is inevitable. We saw it with electricity. And at that point, as companies and as leaders, our responsibility is to do our best to make sure it happens rightly for society. Whatever you can do: the carbon footprint, transparency around what you're using, how you're using it and how it's implemented. We cannot just say, that's somebody else's problem, I'm just going to use it. That's ignorant, and it's not sustainable for society. Rules came in with electricity. The right expectations of companies started coming in. That will happen with AI as well, and all of us as companies have that responsibility.

Josh Rubin

You live in the Valley. There is no place more central to the creation of this technology anywhere in the world, and the conversations happening around town are different from the ones happening outside it. I ask everybody the same basic question: are you hopeful or are you anxious? They say, I'm an optimist, I think things will turn out okay. Then they turn around and say, but I've got a backup plan just in case. If my family needs to do something, if I need to build a bunker, if I need to go off the grid. That's when I get most concerned, when I hear good people say, just in case, I'm going to bug out. We need all hands on deck. We need more people looking at this problem, thinking about how things are being implemented, not allowing ourselves to be steamrolled. So in the conversations you have around town, what are you hearing?

Dhwani Soni

I hear you, and I think the concerns I'm hearing are absolutely valid. Even the most hopeful and optimistic people, all of us, should have a backup plan, with AI or without AI, in life in general. I'm sure some people disagree with me. They'd say, no, you need to go all in, otherwise you won't achieve your goals. But we are at a point where not everybody understands what AI is capable of, and it's capable of a lot of things. How are jobs going to evolve? Should I be sending my kids to college? Should I get a backup job? How do I guide my kids? Those are fundamental questions, and they're still prevalent in the Valley too. We are at an inflection point, and we cannot disregard that this is happening. It is happening, and it is going to happen. To each their own in how they accept it. There's nothing wrong with having a backup plan. There's nothing wrong if a bunker is your backup plan, or a second job, or a second, third or fourth source of income. The point is that this is happening, and how you plan to accept it, and how quickly, is what matters.

Josh Rubin

Humans have a short attention span and a bad sense of history, and every generation likes to think it's living at the end of history. But as a decent student of history, I can't think of a society that experienced change at this pace and on this level. From a monumental election, to a global pandemic, to a new technology emerging that is fundamentally shifting capitalism, the resource distribution system we all live under. Culture is shifting, and it's rare that you get to realize it while you're in it. Not everyone perceives the world that way, and the pushback outside of here is real. It feels like we're sociologically doing exposure therapy on everyone at the same time.

Dhwani Soni

Yeah, that's a very interesting way to put it.

Josh Rubin

I don't like spiders. But if you told me spiders are the only way I can feed my family, and I need to spend a bunch of time hanging out with spiders, I'd have a real hard time getting into them. So I don't know that we as a society have reckoned with what this means when not everybody is into it. How do we talk, how do we empathize, and how do we ease the transition without destroying ourselves?

Dhwani Soni

Oh, that's a loaded question. I don't know where to start. Where we started was, have we gone through a change like this in our living history? As you mentioned, the pandemic. There were pandemics before, but we didn't live through them.

Josh Rubin

We went from no internet to internet.

Dhwani Soni

Correct. But the closest, I feel, was the arrival of electricity. Even that wasn't the same inflection point we're at with AI. Electricity was inevitable once you had it. We had the Industrial Revolution and everything that came after it. But it wasn't at the accelerated pace at which AI has brought us to this point.

Josh Rubin

And it didn't do our thinking for us. It was, I can't see at night, to I can see at night. It was, I had to take a carriage, to now we have better modes of conveyance.

Dhwani Soni

You're right. The big difference is that thinking was not overtaken, if I may say that. But what it did overtake, which is similar with AI, is the workflows. In a moment of inflection, what changes is the workflows and how you adapt to the new world. If you apply AI to the workflows that exist today, you'll probably get a faster horse cart. But honestly, with AI, you won't have horse carts anymore. So what does the workflow look like in an AI world? Does it help us go faster? Sure. Is it more efficient? Do we even need to be involved? That's where AI is doing the thinking for us.

Josh Rubin

Technology that replaces physical labor changes how we live. Technology that replaces our cognitive abilities changes who we are.

Dhwani Soni

Yeah.

Josh Rubin

That's the difference, it feels like. The historical equivalent, for me, almost feels like the invention of writing and the book. I think it was Socrates who bemoaned books because they made it harder for people to think, since they didn't keep as much in their heads anymore. But even that doesn't have the same impact, because books and writing weren't as widespread. They were relegated to a very specific part of society. If this is available to everyone, it changes how everyone thinks and engages. I don't know that we have any historical analog for that, not at this speed.

Dhwani Soni

This goes back to how we started: what is our responsibility in all of this? Electricity came. Calculators came, and calculators were banned in schools. I think development, vibe coding and building products with AI will become part of the curriculum, but how much AI you use in your learning needs to be controlled. I go back to anthropology. We bring our biases to technology, and that's essentially what AI is doing too. All of us are feeding our biases into AI. That's where we preserve our judgment as humans. If a product is built by a human and tested by a human, they carry the same bias they pushed in when building it. We have to separate that out and use our judgment about what is right and what is wrong, even with the biases we picked up in childhood. That's what we owe the next generation: helping them lean into learning and reading. Yes, they can read through AI, but also actually reading books. We owe them the internships and apprenticeships we talked about, giving them the ability to experience things without AI, or with AI, but still learning from the ground up. That needs to be preserved, and that's our responsibility. Not just somebody sitting in Silicon Valley or at a company, but all of us today. We have a responsibility to the next generation.

Josh Rubin

You're talking about stewardship. Ultimately, the product here is society. Our product is humanity. If we don't steward this appropriately, not to socially engineer, but to steward, to be responsible and have real conversations about it, there is no one coming to save us. It's imperative on all of us to say, my life is my product, and I must be deliberate in how I engage with it. And if you vibe code your life, don't be shocked when the result isn't what you expected.

Dhwani Soni

I agree. And I also think we can do the stewardship, but it has to start with acceptance that AI is here and it's going to happen. Then we have to figure out the responsibility around it.

Josh Rubin

I think stewardship begins with what reality is. AI is a thing. To pretend otherwise is absurd, and burying your head in the sand helps no one. But I don't know that it's a foregone conclusion that everyone just has to do it, because I don't think we actually understand what the medium or mediums of AI are. If it's a tool, then saying everyone has to get on board is like saying, the hammer is real, so you'll just have to get on board with said hammer. I don't have to accept every aspect of how AI is being implemented if I think it's a net negative. So, are there things AI could do that you very specifically don't use it for? You could easily throw a problem to AI, but you don't. Can you think of anything?

Dhwani Soni

I don't want to make a blanket statement, but where I feel I need to preserve judgment, I would still use AI to do data crunching, look at evidence and provide that to me. But at the end of the day, the decision should stay with me. It can give me proposals, for sure, but I want to retain the judgment: is this the right thing to build? Is this what the customer is looking for? Is this what I would invest in as an organization? That judgment still needs to be preserved. Tomorrow, with the pace of AI, will that go away? I don't know. Probably. Hard to say. But as of today, I want to preserve that judgment. Give the right tools and the right mediums to everybody in my org, tell them what the outcome should be, and give them the autonomy to run with it. That's what I think leadership should do in the world of AI.

Josh Rubin

The missing piece, and the thing I don't know that we've solved yet, is trust. I trust people, not all people, but I can put my trust in people. There are brands and organizations I trust because, through experience, they've earned it. Has AI earned your trust yet? That's a blanket question, like asking whether hammers have earned your trust. My philosophy, with AI or without, with people, companies or situations, is trust but verify. We're going full Ronald Reagan here. So what skepticism do you bring right now? You can't interact with any of these AI tools without ceding some trust.

Dhwani Soni

Here's an example. If you're doing a repetitive task and you have a way of doing it, you'd want to verify what sources AI brings and how it did the thinking. That's how you build trust. Even as a leader in design: how do you build trust with the end user of your product? You show them the thinking behind the AI. Then they can verify: okay, I trust this, I would have done it this way. Once they've done that, and it's a repetitive task, you can convert it into a skill that runs automatically. At that point you don't need to be babysitting it. It's done, and you can trust it. So I can't give you a blanket yes, but for repetitive tasks, once I've conquered one area where I applied AI and it worked, it fits my mental model. I trusted it, I verified it, and I can move on to the next one.

Josh Rubin

You can trust that skill until you realize, oh, the output isn't as good as it was yesterday. Why? I picked the wrong model. So you try another one. That's life. You've got to trust AI like you trust people. Things change.

Dhwani Soni

Yes, things change. You keep doing your checkpoints. But what you just described was a judgment call. A model or a skill that was working before isn't working anymore, so you go back and check. That's exactly what you did.

Josh Rubin

A lot of the fear about the next generation, I'm realizing, is bullshit paternalism: those kids will never grow up to be like me. My parents thought I'd be a ditch digger because I watched so much television. They told me that constantly growing up. Then I went to work in television. Every generation thinks the next generation is stupid. I don't think we're giving kids enough credit. And I've just realized it now, which is why I like having these philosophical conversations: the kids will be all right. But we're all worried that we're completely screwing them up.

Dhwani Soni

I think our responsibility, right or wrong, is that they need to hear all sides of the changes happening. We can instill our ethics and our thinking, but they should hear both sides, and at the end of the day they are their own people. They have to make their own decisions, and that's their life. I know it's very philosophical, but how long can you keep a mobile phone away from them? How long can you say no iPad? They're going to see things and talk, and their friends will tell them about Roblox or whatever. You can't shield them forever. The best way forward, at least in my philosophy, is to give them as much exposure as possible. Read, write, watch, whatever it might be. Try it with your hands, and learn.

Josh Rubin

Part of me is glad all of this is happening now. I'm 48 years old. It's the perfect age to still see the ramifications and engage with all of this. I've got my father at one end, saying no, you're not allowed to play with this, ever, and my kids at the other end. For those of us in the middle of this transition, I'm both glad I'm not older and happy I'm not younger, and there's some stress that comes with that. It is our responsibility to figure this out.

Dhwani Soni

I'm glad to be at an age where I can embrace this. I have enough years ahead of me to actually learn it, embrace it, use it and apply it. If I were much older, I don't know how much capacity I would have to embrace a change this huge. There will always be naysayers, but I think the answer is to keep an open mind, listen to everything, and do what you want to do.

GET INVOLVED

Be part of the
conversation.

Whether you're a CTO who wants to be featured, a company looking to sponsor, or an engineering leader wanting a seat in the room — there's a place for you here.