AI Summary
In this AI Insiders episode, Dr. Cecilia Dones, a qual-quant researcher and AI ethics educator, discusses the transformative impact of AI on marketing. She argues that the industry is shifting from human-centric to agent-centric campaigns, where machines mediate brand-consumer interactions. The conversation centers on the critical need for trust, transparency, and accountability in this new landscape, offering frameworks and practical advice for marketers.
Chapters
Dr. Cecilia Dones introduces herself as a qual-quant researcher with experience at WPP, Publicis, L'Oreal, and LVMH. She teaches AI ethics, including to K-12 students, and will be at NYU in the spring.
Dr. Dones explains that marketing is moving from human-centric campaigns to an agent-centric ecosystem where machines mediate the process between brand and consumer. This is driven by developments like OpenAI's integration with Etsy and the rise of AI actors like 'Tilly Norwood.'
The consumer journey is collapsing as AI agents remove intervention points. Marketers must rethink the ecosystem when machines act on behalf of consumers.
Dr. Dones introduces the BIC framework for building trust: Benevolence (consumer benefit), Integrity (delivering on promises), and Competence (reliable execution). She argues this is essential when using AI.
Dr. Dones highlights the lack of transparency in AI-driven recommendations and AI actors as a major trust issue. She contrasts this with virtual influencers in China, who are transparent about being AI.
A participant shares that 80% of AI initiatives in corporations are failing, emphasizing the need for a clear purpose and understanding of AI's ontology before implementation.
Dr. Dones gives an example of an airline using AI for 'surveillance pricing,' which can lead to unethical outcomes like price hikes based on urgency. She stresses the importance of considering second and third-order effects.
Dr. Dones argues that marketers should measure trust-related components (confidence, comprehension, consent) rather than just engagement. Consent should be continuous, not a one-time event.
Dr. Dones suggests that marketers can take a proactive stance by building 'seatbelts' for AI, focusing on transparency, understandability, and accountability to mitigate risks.
A participant discusses the importance of RAG solutions and fine-tuning for creating bespoke AI models. However, even with these methods, hallucination can occur in up to 10% of citations.
The conversation concludes with a debate on accountability. Dr. Dones argues that marketers must be the voice of the consumer and ensure there are mechanisms for redress when negative outcomes occur.
The video underscores that as AI agents reshape the marketing landscape, trust becomes the most critical currency. Marketers must proactively build guardrails, prioritize transparency, and focus on accountability to navigate the agent-centric future successfully.
Mentioned in this Video
Research Wonks
service
WPP
service
Publicis
service
L'Oreal
service
LVMH
service
NYU
service
OpenAI
service
Etsy
service
Tilly Norwood
person
Screen Actors Guild
service
Lil Miquela
person
BMW
service
Delta Airlines
service
Perplexity
tool
Advertising Research Foundation
service
Marketing Science Institute
service
Columbia University
service
Sam Altman
person
💡 Key Takeaways
The Shift to Agent-Centric Marketing
This is the core thesis of the video: the marketing ecosystem is moving from human-centric to agent-centric, fundamentally changing how brands and consumers interact.
05:45The BIC Framework for Trust
Provides a practical, research-backed framework (Benevolence, Integrity, Competence) that marketers can use to build and measure trust in AI-driven interactions.
13:24Hallucination Persists in RAG
Reveals a concrete limitation of current AI: even with RAG and fine-tuning, up to 10% of citations can be hallucinated, highlighting the need for human oversight.
42:37Measure Trust, Not Just Engagement
Challenges traditional marketing metrics and suggests a new set of KPIs (confidence, comprehension, consent) focused on trust.
26:59Marketers as Seatbelt Builders
A powerful analogy urging marketers to proactively build guardrails for AI, rather than waiting for regulation or market correction.
31:14Full Transcript
[00:07] welcome to another edition of AI Insiders by AI Marketers Guild and we've got an exciting guest today. Someone I'm really eager to hear from Dr. Cecilia just tremendous background as a chief data
[00:22] officer among other esteemed roles and we're geeking out on what's going on AI space. We met through initially another community I've been a long time member of Research Wonks a big fan of that for for folks
[00:37] who are deep in the data and analytics space and about 90% of the posts there are over my head which is why it's fun being in some rooms where where where there are such smart people so deep in the field that
[00:52] from but Dr. Doan's Cecilia welcome. Good to have Thank you. Thank you and thank you for everyone for joining. I know it's the
[01:04] middle of the week. It's also lunchtime for some of us who are on the East Coast and so the dedication and attention is much much appreciated. Yeah. So would it be helpful unless everyone LinkedIn stalked me which could
[01:18] be a thing you're definitely okay to do that. So a little bit about me. So I am a qual quant researcher who So I am a qual quant researcher who spent my entire career being fascinated
[01:31] using data. And so everything I've ever done is following that curiosity. The good part of my industry experience was focused in marketing and ad land. So I have done my tour duty with
[01:47] WPP and Publicis and I've also done a tour duty on the brand So some brands that may be familiar L'Oreal LVMH and more recently
[01:59] all do. I finished my doctoral dissertation and what I was focusing on was trust and authenticity signals in technology mediated interpersonal communications. Which is the longest way of saying I
[02:16] Which is the longest way of saying I have trust issues with the internet anymore. And so I figured maybe some research in well. What I'm doing recently
[02:30] I do teach so I teach primarily AI ethics. More recently I have been teaching K-12 AI ethics which is very interesting. So trying to speak about AI ethics and
[02:44] responsible AI to middle schoolers Oh so many things I've learned but it's very interesting to see how organizations are really investing in the youth. I teach that. I will be placed in NYU in
[03:01] the spring teaching emerging technologies there. So I will be technologies there. So I will be continuing that. And I hang out in the responsible AI AI ethics space writing doing a little bit of research
[03:15] and consulting organizations that are trying to do this AI thing a little bit better. So in transparency David and I collaborated or conspired to have this
[03:27] conversation after he was back from holiday holiday because I had mentioned AI fake oh yes fake well first of all fake news and then AI fake news that makes it a little
[03:39] bit more complicated but David and I actually wanted to was back from holiday because I had mentioned my secondary research area mentioned my secondary research area which is AI artificial intimacy.
[03:53] So when we start to have relationships that are a little bit interesting with machines and what does that mean from a individual level and more broadly at the
[04:05] societal level. But keeping it in marketing land I was like okay I totally have a talk I'll have slides all the things all the things and then the news and when the news happened about open AI and what they're doing
[04:19] with Etsy collapsing the marketing funnel and I said oh dear okay this is interesting this could be good for consumers or it could be interesting how marketers deal with it because there's almost no more any
[04:34] the journey collapses intervention points are removed from the process and then like within the last 24 hours which totally blew up my whole talk does totally blew up my whole talk does anyone know who Tilly Norwood is?
[04:52] Okay yes some would argue that this is our first some would argue that this is our first worldwide AI actor and apparently she's worldwide AI actor and apparently she's looking for an agent. And so these two
[05:05] things represent what's happening in the latest wave of technology. And so I was thinking about it this morning actually as my presentation was blown up.
[05:19] Us as marketers our discipline began with oh gosh we have to listen to our consumers. We have to understand our customers. We we are very human first. We have to be um making sure that there's always an
[05:33] alignment between product and the consumer and their consumer needs. And so we spend a whole bunch of energy at trying to understand consumer However with these latest developments in
[05:45] technology that's changing our ecosystem. We're moving from what I would argue is human-centric campaigns where we have personas we focus on people hopefully people to more
[05:58] of an agent-centric ecosystem meaning the machines are mediating so much of the process between the brand and the consumer. It forces us to have to think about this
[06:11] ecosystem in a different way. And I will put this idea out there. If anyone wants to write this textbook I'm more than happy to be second author third author even an honorable mention I'm very happy to. Something I was
[06:25] write and maybe as practitioners it would totally make sense. AI marketing for AI when machines are selling to machines. I think that's it's a little bit
[06:40] it but I think that's where the industry is moving forward. Meaning more and more of the interactions especially in virtual and digital spaces will be mediated by these technologies that yes convey help
[06:55] these technologies that yes convey help us it is a medium to convey our messages but they also And that's the slight distinction from maybe previous iterations of technology. Previous iterations of technology was
[07:07] more like facilitating facilitating some of the consumption and so e-commerce all had to think about our e-commerce websites. But this one is a little bit different in the sense that there is more agency and so do I think agentic is
[07:23] going to be a thing in 2026? We'll talk about it a lot. Maybe some brands will make mistakes that we can talk about even more. experience? I'm cautious. However it is something
[07:38] for those of us who are marketing leaders and marketing strategists and longer I think we have to actually really do properly think about how do we think of this ecosystem when the consumer journey has collapsed and that
[07:52] when machines on act on behalf of consumers itself. um And and I mean the bringing up Tilly Norwood right now and we had the Screen Actors Guild coming out very strongly against this and and
[08:08] out very strongly against this and and making a stance for human creativity. Um but it's also fun cuz like uh we also I was like so much of what we
[08:20] consume right there they're characters yeah we're going and we're watching the Marvel movies because of the characters in them
[08:32] it's it's less important I think for most folks who's actually playing them although it's really fun to see Robert whatnot. But then
[08:45] also at this point where like we look at the rise of some of these virtual influencers like Lil Miquela that BMW actually did a sponsorship with and then like they're like Lil Miquela for
[09:02] is getting gigs anyway right? Like getting gigs anyway right? Like there there are people paying her it there there are people paying her it it's team to go and and run branded
[09:16] campaigns. So it's like like how do we even draw lines I mean one thing to draw what's AI but when like so much of what we
[09:28] consume anyway is some like some some CGI created character to begin with when consumers are already like following these characters that don't exist in
[09:44] real life. I mean like like how do we even make these distinctions anymore and is it like and I'm even curious your take cuz like I love like human first everything over tech, but
[10:00] like are these actual battles worth fighting? Like like is this like like is defense here, the Screen Actors Guild, or is this just like some lost cause and they're going to be seen as yeah, fighting some battle that
[10:16] that like that well, that ship sailed, right? Like I'm I'm so curious where where you're thinking of this as you see this controversy around Tilly and Nora would come up. Yeah, no worries. Um
[10:30] changed because business models are changing. That's just a given. As dynamic ecosystems change, obviously the mechanisms and incentives that we have um to incentivize different behaviors will also change. So, that's going to
[10:45] happen. Do I have a crystal ball? No. Um how it will change, I don't know. What I will say is that um maybe and I could be more clear about this is the two examples, the OpenAI with Etsy and and this Tilly
[11:00] situation. What makes it a little bit gives me the ick is that these platforms and these technologies are removing some of the social signals that we would normally depend on when we
[11:16] are trying to build trust. And as marketers part of our remit, part of our um the promise or the value we we create
[11:28] for the organization is we hold that trust with the consumer. We ensure that as best as we can, um we are continuing to reinforce that brand. Are there uh cases where there are
[11:45] cultures, for example, this is very common in China, where you have virtual influencers that actually do live streaming and people still consume and it doesn't bother them and it's part of the cultural norms and values?
[11:58] Perfectly fine. They are transparent that these are virtual influencers. So, in the case of uh ChatGPT and uh Etsy when a consumer starts to say, "Okay, I need a new charm for an or gift or
[12:13] and something pops up as a recommendation is it coming from OpenAI? Is it actually coming Is it um the reviews from Etsy? Where is this
[12:26] recommendation coming from? Is it biased? Is it actually Is the brand actually paying for it? We have no more signals for this. And that's where Tilly situation, I I get it. Good for PR,
[12:41] but the lack of transparency that hey, she's AI and they were running all these adverts and messaging around her. Um yes, it does get her in news, but again, it's one of those things where it's one of the fundamental components
[12:55] uh regarding trust uh in specific. That there needs to be some level of um one's perception and belief that the other person is going to act in such a way
[13:08] that is one beneficial um two I would argue uh helpful and then three kind of consistent. And I can give everyone a little bit of a framework here.
[13:24] Um So, uh researchers from many many moons ago, it's called the BIC framework. I'm I'm quite certain some of us are already familiar with it. Um so, in building trust and this was done with organizational psychology
[13:37] organizations trust each other and then more importantly, how do people inside those organizations trust each other? We had to prove benevolence. Is this actually going to help the consumer? What is the consumer benefit?
[13:50] What is the consumer benefit? In AI land, um common violations is that what's the distinction between manipulation versus a nudge? And so, as us marketers, when we think about utilizing AI responsibly
[14:03] Sorry. Or let's say, let's not hold our breaths for a federal regulation at least here in the US. So, that means at the leadership level at the organization, we're going to have
[14:17] to make these decisions. So, one, benevolence. Two, integrity. Are you going to deliver on your promise? Are you going to surprise? Are you going to uh surprise me in a not so good way? Or are you going to be transparent? So,
[14:31] when we use AI for hidden automations, if we have exaggerated claims, um there has been already um uh cases where firms have been fined for
[14:43] exaggerating claims. In in the data space, we tend to call it AI washing, um but in other contexts, they use different words. But the idea of uh going beyond um puffery uh this is something that's critically important to
[14:56] make sure that we are reinforcing with our consumers that we our brands have integrity even when we're using technology. And then uh last component, uh competence. So, can we consistently show up? Can we execute reliably? And
[15:10] so, if we use AI um technologies to help facilitate the conversation, okay, fine. We we have a chatbot. Excellent. Good idea. Is it actually making relevant recommendations?
[15:23] Um when a consumer tries to find out a little bit more information about a product, does it start to hallucinate? Did we actually check for that corner case, use case, all of those things? Um are we actually reinforcing that
[15:36] we know what we're doing with this technology. And so, when we're trying to reinforce trust between the consumer and the brand, benevolence, integrity, Um these are the questions I ask marketing
[15:52] leaders all the time. Help me understand how are you actually showing this and demonstrating this to your customer as opposed to let's see all the shiny uh that we can do with AI and technology.
[16:05] And with that, I'm going to pause for a second um because I see one hand raised. Karen, I see you. Would you like to add or challenge? Uh I would like to add
[16:22] So, the first question that comes to mind is all of these ideas, do they actually work? Right? So, agents talking to agents and eliminating people, you see so many reports out there that 80% of all these
[16:36] AI initiatives in corporations are failing. They're not producing the results that they are intended to produce. that um resonated with me and the title was
[16:53] resonated with me and the title was philosophy beats AI and they broke down uh the philosophy of why you want to use AI and they said that the first most important thing is your purpose.
[17:06] Why are you wanting to use it? For example, in the example that you For example, in the example that you said you gave for uh having uh
[17:20] uh AI actors replace humans what's the purpose of that? Is the purpose to cut costs? What why are you doing what you're doing?
[17:32] And then the next one and you talked about that is the ontology, understanding the nature of AI, of what it can and it cannot do. Uh
[17:45] whether it's giving you the right recommendations so, that is critical. I think a lot of people kind of freak out about AI because they
[17:58] really don't step back for a second to say, "Okay, all of these ideas are there, but will they actually work?" And uh a lot of that also
[18:12] requires a lot more understanding of the human nature human nature to be able to um assess what the benefits and the dangers of AI are.
[18:28] very very much so. I think there has to be a radical clarity around the why or what is the um particular consumer benefit. I mean, we can you can pull it back into economics, right? So, all these big
[18:41] firms that are having multi-billion valuations, they're not particularly profitable at the moment. And if they want to have subscription models at 200 or 200 plus a pop uh they can keep trying, but it's not going to be
[18:55] particularly scalable. So, they are going to have to shift their business model such that they can be a bit more revenue positive and then eventually profitable. So, it's not going away. Whether or not it degrades the consumer
[19:10] experience, uh I agree. I agree. The using technology for technology's sake, um yes, most likely we're going to have all sorts of poor experiences. I'll give you an example where I put on my AI
[19:22] Recently um and this is where I get very curious about the the PR team or the comms team I believe it was uh an airline and I I want to say it was
[19:37] Delta Airlines. They got very excited. They wanted to communicate they were utilizing AI. And the way they were utilizing AI was, "Oh, well, you know,
[19:49] uh we can use AI to like figure out this pricing challenge. So, for individuals, maybe large enterprise businesses, maybe they can pay more for a ticket versus somebody who's a regular person, mid-range, whatever, and and they can
[20:05] maybe pay less. And so, you know, people with deeper pockets, fantastic. We can like AI this problem and suddenly we'll we'll make sure that the flights are we'll make sure that the flights are full and and we'll be able to extract a
[20:18] bit more value from different consumer cohorts. this. And then it became very quickly for for circles, oh, okay, this is nice. This sounds like
[20:34] surveillance pricing. And so, now they're utilizing data signals, maybe your zip code, maybe your previous purchasing behaviors, maybe the previous places you went to,
[20:49] to determine oh, whether or not you should pay an extra 200, 300, 400. Okay, maybe that's a little bit icky, maybe a little bit. Where it gets really icky is
[21:02] what if in the data marketplace, and this does exist, really smart and they start figuring out, oh, wait, the behavior of this individual, we
[21:14] don't need to know who they are, but the behavior of this individual, it seems like they need to purchase a ticket in urgency. Somebody passed away in the family. A new birth in the family. I need to go
[21:27] from here to there very, very quickly. I don't have time. It's time sensitive. What if an airline jacked up the prices a result of that because that's what the >> And and this is really >> And those are the use cases where AI
[21:41] ethics and responsible AI is so critical because it's not a first-order effect that we're worried about. It's the second and third-order effects that I would argue marketers, we are in many ways, we may be the only voices in our
[21:55] organizations that represent the consumer. I I can I say something? I would argue argue with you that this is really not AI ethics. It's human and corporate ethics. You're using tools to do something
[22:09] that's unethical. Data and science does what data and science does. It's not it's objective in its own way. It's the human beings who are using that data to
[22:22] extract, you know, do whatever it is that they do. So, it has no it's not I would I argue against AI ethics. This has nothing to do with ethics, capitalist ethics, and uh
[22:37] really the core problem with human nature and culture, not technology. Fair. Um technology is a tool. I don't argue semantics because I think most disagreements are a result of slight
[22:52] variations of definitions. Um if it changes behavior, that's when I say, okay, we need to come to common ground. So, if I say corporate to a board, well, that change their behavior.
[23:07] If I say AI ethics or responsible AI, well, that change their behavior. well, that change their behavior. I We are saying um our values are aligned. I think the words we use in different forums are the ways that we
[23:20] kind of persuade the argument to move things forward. I mean, we are in a marketing forum, right? So, marketing, and I did promise to talk about technology.
[23:35] Um but I appreciate the point that maybe technology is we can be philosophical, Um I appreciate the point that maybe technology is just a further extension of all the tools that we've ever made. So, fire included.
[23:54] recently came across in the internet that I got really excited about because it came back. How many of us remember Clippy? Of course. Okay, yes. Uh that that weird
[24:10] Okay, yes. Uh that that weird uh the the weird paperclip um that used to try to be ever so helpful. Oh gosh, I can't remember what decade it age myself, so we're we're just going to say it was a while ago.
[24:24] Um and it was really annoying at the time um because it would constantly be popping up um in your word while you were using Word or while you were using Excel to try to help you. And I argue that as our as brands
[24:38] And I argue that as our as brands continue to experiment in this space, experiment with trying to use technologies to deliver different kinds of value to consumers in their experience,
[24:53] broad-based regulations, given that maybe we don't necessarily agree maybe we don't necessarily agree um on what values and rules to uphold, that brands may want to consider how do we show ourselves to be a bit
[25:08] more like a Clippy? And why I argue that is that um Clippy was not always the most helpful, but it was very transparent at what it could do and what it could not do.
[25:24] um always being very clear that it was there. And so, I I really want to focus on kind of the transparency and understandability understandability components regarding
[25:38] technology use. I don't have to use the words AI anymore if we don't want. Um and so, as marketers, as we continue to use these technologies, I ask the question always, are we being clear to the average
[25:51] consumer? Are we disclosing in a way that they understand? Are we owning the limits around these technologies, meaning you know what, this chatbot is only good for
[26:06] I don't know um uh figuring out how to return a product. Maybe it's not good at extrapolating out in like different use cases of the product. Okay, be transparent about that. Um being clear
[26:20] that users should have some form of consent mechanism. Okay, you don't want to talk to the chatbot anymore. Um you want to speak to a real person. Okay. Um making things are understandable
[26:34] to the end user. So, showing the reasoning as appropriate to the end reasoning as appropriate to the end user. So, if it is a B2B firm, B2B SaaS, and um you're talking to devs, so it's developer
[26:47] evangelism, the way you communicate and speak will sound quite uh from a marketing standpoint as opposed to if you're speaking to the average consumer Um and then from a measurement
[26:59] standpoint, I get asked this quite often, okay, if we're not supposed to be measuring engagement, what are we supposed to be measuring? I would argue we need to measure the components related to trust. So, like
[27:14] how confident is our consumer? Meaning, do they understand what technologies are we using? Do they understand how the output came about? Um the comprehension, do they understand
[27:26] what they can do or what they can opt in and opt out of? And then I tend to say this quite often, um consent, consent, consent. And consent isn't a one-time thing. It's a continuous thing in the sense that it is
[27:40] it happens throughout the life cycle, throughout the process of the relationship of the consumer with the brand. And so, I figure that doing those types of things can help to mitigate any
[27:52] potential risks um when it comes to utilizing these know what the second or third-order outcomes will be. David, I didn't realize your the chat is on fire. Yeah, there's a lot going on in
[28:07] it in the chat, so I was just checking on that. Any questions? Are are we in Smith Group? We are. We are today, so I'm okay if people want to raise hands or throw out a
[28:21] provocation. So, I mean, I'm I'm curious that as we talk about ethics and you mentioned that like uh regulation isn't coming here anytime soon in any
[28:35] meaningful national way. Right? Um So, it it So, what's going to motivate to do more than the law demands
[28:52] in that sense? And you know, it's like uh and and you know, in terms of uh in terms of ethics around AI, like like if
[29:04] acting in if there's not going to be any like legal penalty for acting unethically in a lot of cases or area, um like for like for those that you're
[29:20] seeing trying to do things right, like what's motivating them? what's motivating them? And is there anything that can like help our markers that want to do the right thing, but might face an uphill battle
[29:33] you know, not necessarily being required of them? Very true. It can be quite challenging. This is why in practice I tend to say responsible as opposed to ethical because one we have
[29:48] to agree on ethics. That's not always true. policy which in the US not likely to happen. So from a responsible standpoint Again, I continue to reiterate
[30:03] transparency, understandability, and then accountability with consent. If marketers can do those things, you mitigate some of the risks. You asked me if there are any firms that are thinking about doing these things
[30:18] and how are they kind of addressing it? I see a lot of this already happening inside of the mental health care tech space. right. And yes, it could be for the greater
[30:33] got Did Sam Altman just get sued because very unfortunate irreversible poor outcome has occurred? Yes. A teenager
[30:46] had decided to end their life as a result of a relationship, a parasocial result of a relationship, a parasocial relationship with ChatGPT. That's That's Open AI. If you are in a firm that maybe is not
[30:59] necessarily as favored in the marketplace in the moment and you're you want to take those risks? And so that's where I feel like marketing can take a proactive stance. And
[31:14] take a proactive stance in terms of building these guardrails. I I tend to make the analogy. We have choices. Um We have a very very fast-moving car and
[31:27] the cars are only getting faster. And so that is what the platforms are right to do so. They're well-resourced to do so. However, those of us who are facing consumers as part of our roles
[31:41] we have a choice to say hey, can we build some seatbelts? Hey, can we tell people about seatbelts? There's no no requirement to force people to wear seatbelts and it's going to take a long
[31:56] time if that's something that we as a society choose to do. But the fact to raise the idea that hey, we should probably have seatbelts we want to mitigate any kind of litigation risk or hey, or we want to
[32:10] talk about seatbelts because you know reputational risk is a problem. And this is something we want to manage against. So imagine a world very soon where we
[32:22] use only the LLMs to do our exploratory search. Help me I don't know. Perplexity, help me book a vacation and Perplexity gives me the hotels, gives me
[32:34] all those things. The brand will no longer have intermediary control. So if um in that scenario, it offers me a Hilton versus a Marriott and in my mind I'm
[32:48] like ooh, Hilton. I'm not sure if I'm okay with all of their business practices. I may choose differently. And so the role of the marketer I think slightly changes
[33:02] when it comes to all of these more recent technologies. Meaning trust becomes even more important. Brand becomes even more important. And those are not performance marketer type of ideas.
[33:17] arguably more traditional brand marketing. That's where I think marketers can take a proactive stance. important? Seems like they'd be less important if you have AI agents making
[33:32] the consumer themselves. There will be a consent mechanism, right? What what happens if we have a whole bunch of random agents like just booking
[33:46] vacations and buying you say buying goods and services. Okay, me as a consumer I say no no, my agent made a mistake. Credit card undo that. Undo that. That creates all sorts of second order and third order
[34:00] effects of ignoring transaction this and that. And so the marketplace will have to figure out what are those mechanisms to minimize that. But there will be some version of consent because many people as they learn this new behavior of
[34:13] having agents purchase things on their behalf will make mistakes. because there is the future state that may happen, there's the current state,
[34:28] and then there's the actual harms that are occurring now that we could actually against. I would agree that we are in the very much in a new field in terms of the jump from search to social, social to mobile.
[34:45] Now it's the AI and we're going to see where what brands are doing are doing moving fast and breaking things and I think there'll be a market correction. philosophical debate about that's debatable, that's subjective I think in
[34:57] a lot of ways, but at the end of the day it's going to be the bottom line and brands are going to respond to how their implementation and configuration of AI and how they use it for their consumers were impacted bottom line. So you can
[35:10] about brand values from a branding standpoint, but at the end of the day it's about the money and if that's why Pepsi pulled the ad Jenner, that's why we had the conversation with Jimmy in last couple weeks. At the end of the day
[35:23] how we choose to use AI or how brands choose to use it will be impacted by how it affects their bottom line initiatives. That's just my argument. I hear you. So it sounds like this crew is very much
[35:36] me. I'm not suggesting every brand has to use AI. Not all problems are solved by AI.
[35:48] Agreed. But my bias is I am very much focused on trying to understand what to trust, who to trust, and what is the role of marketing in helping me understand who to trust, what to trust.
[36:12] Outside of generative AI capabilities I'm curious if anyone has any current experience utilizing AI AI technologies to try to enhance the consumer experience. If not or just just do an efficiency
[36:28] I'm curious about people's experiences with that. with that. I have developed a rag and I think in in my experience what's critical
[36:44] is to understand the nature of AI and when you have a rag solution and you add your own content and uh then let AI act on that content, it gives you a much deeper
[37:00] understanding about the value of it but also the shortcomings and how you can fix the problems. You know, the the the key thing for using AI in anything is right now
[37:16] why you want it. If your if your idea and I think that's where the market has failed a lot is a lot of the corporate heads, their first thought is AI is going to help save me a lot of
[37:33] because I don't have to hire people and I can shortcut things. If that's your thinking, I think that that is a recipe for failure. But if you have a very clear idea and objective for what you
[37:48] want to achieve and then have a very good understanding of the strengths and limitations of AI. What is hallucination, inference, how the and you can really get a good understanding of it when you
[38:04] know the content that is being used to generate those answers. Then you can certainly have ideas, you know, and I think a lot of great solutions for customer support, you know, I think rag
[38:18] solutions have a big play in how AI how AI will be used in the future. Content generation and content marketing is also good, but you have to have a
[38:31] very good understanding of the nature of AI and also understand that a lot of it is a black box. I mean, the interpretability of AI, the fact that
[38:43] even the people who built it don't really understand how really understand how some answers are inferred how it actually makes decisions and if you have those black boxes, then
[38:58] and if you have those black boxes, then applying AI to some really serious applying AI to some really serious critical applications will become very challenging. But if you have a very clear purpose of why you want to use it,
[39:10] I think there's a lot great great understandings and I think that AI great understandings and I think that AI agents are also again, if the focus is clearly defined, then I think you can have success. But to think that they can
[39:25] have success. But to think that they can just do the job of a human is not realistic. In HR circles, yes, that is definitely the sentiment. I loved how you were bringing up
[39:38] a little bit more technical conversation. So I had the fortune and experience to actually be able to attend the Advertising Research Foundation's um and Marketing Science Institute
[39:50] conference earlier this week at Columbia University um around analytics and forecasting. And without getting too too technical, I'm not sure everyone's background. Um what was very promising in terms of
[40:03] Um what was very promising in terms of how do we make this AI actually useful? most of the presentations similar underlying thread. You cannot take underlying thread. You cannot take anything off the shelf. Don't that idea.
[40:15] anything off the shelf. Don't that idea. Um however, you can utilize rag methods um and and constrain the the information
[40:27] related to the context of your business. So, the externalities of the the your competitors, for example, things like that. While utilizing also fine-tuning of those models, so information about your particular consumers, to actually
[40:41] your particular consumers, to actually create a more bespoke uh AI model. Is is explainability and interpretability? Yes, yes, yes. However, when it comes to making things a bit more bespoke um in
[40:54] in such a way that it actually delivers some value that makes some kind of sense in the context of your firm and your customers, um these are methods that combined together can be um quite promising. More
[41:08] more implementation has to be done. In my experience, there's a lot of my experience, there's a lot of engineering required. LLM does a job, but you also have to then be able to process the questions. And
[41:22] then on the back end, you also have to then process um the answers as well. And the more structured content you have in a rag solution, and then you can engineer your content to continuously
[41:37] provide relevant answers. Like recently, I had an experience where you know, the LLMs will always want to create an answer. So, somebody asked a question
[41:54] uh and the answer was accurate, but the reference link that was generated with that answer was not the right reference link. So, the content was still there that was able to create the right answer, but it
[42:08] Yeah. And then when I researched that a little bit, they said that well, you need to maybe tag your content differently in order to be able to So, what I'm saying is that there's an engineering involved in
[42:21] there's an engineering involved in creating systems that work and of how all of this works right now. Yes. Um and even in those cases, uh
[42:37] there has been some empirical work done in this space. Uh even in those cases when we're trying to create lineage and provenance as an output, um we're still getting a little bit of hallucination. So, it can still be up to 10% of those
[42:49] So, it can still be up to 10% of those citations even in a rag architecture and fine-tuning architecture is still the hallucination. And so, yes, there are significant challenges. Um
[43:04] too deep of a technical conversation um because sometimes focusing on the technical conversation abstracts away from I I again, I continue to argue the role of the marketer inside of the
[43:18] organization. The marketer is in charge of the relationships, I thought. Or at Okay, good. >> They are on sales. sales closes the relationship in terms of bringing them on board usually. Okay.
[43:33] ones and zeros and we only start focusing on the platforms, sometimes we forget those things are actually meant to be people. The relationships can hurt if if the answers are not trustworthy, right? So,
[43:48] were oversetting the point. The point of any campaign, any initiative, whether example that uh CEO mentioned before, it's a point is to put something out in the market, get the feedback from your
[44:03] marketplace, from your consumers especially, and then adjust accordingly. And the same way we've been doing it for decades in this new internet industry, 30 years old. We're doing the same thing now with AI. And we're going to teach AI
[44:17] ourselves. My job as an analyst early in my career is to take a look at the data, optimize campaigns. That's what we're teaching AI to do. So, there's no my career to what we're teaching AI to do now. We just have to be more
[44:32] technical end, but technical standpoint, creating structured data. There's no difference. I don't understand this anti-AI bias that you people seem to have. There's no anti-AI. It's understanding
[44:46] that like you said, teaching AI what to do had some limitations because it doesn't always do what you tell it to do because we don't really understand the interpretability parts of the AI. So,
[45:00] >> That's hard training, but that's fine. And that's called training in the same not just training. It's It's not just training. It's training has its limitations. That's what I'm trying to tell you. You
[45:13] can train it all you want, but if if the if the engine is a black box, if interpretability that our engineers who built it are working on trying to understand how it interprets,
[45:26] understand how it interprets, there are limitations to the results. And that's the the reality of this AI. and How in the old days when you programmed something, you always knew
[45:42] what you got out of it. In AI, you don't understand it's a black box, right? You train it with a lot of parameters. There are too many parameters in there and they don't always know
[45:56] how whether the answer is accurate or not. That's what hallucination is. and then you have to put that into the equation. So, I'm going to I'm curious to try to synthesize and
[46:12] further. Um let's let's talk about the automotive industry. And so, now we're talking about long time ago. Um so, there was no
[46:24] we were the cars were competing with horses and buggies and there were no roads, so no infrastructure. And we didn't have laws that said, "Hey, maybe Maybe you don't want the engine to explode. Maybe you want seat belts."
[46:41] Um and so, it was very very new. We were learning into the space. I think the discomfort, and now I'm going to speak for myself, the discomfort I I tend to feel about the whole thing uh is related to I get it, technology,
[46:57] there's always going to be limitations. But what I get a sense of as a consumer, as a person that is participating in the in this, not just an outsider looking there's not enough accountability. So, if something goes wrong, what happens?
[47:12] That's what we're learning now. And that's where it gets a little bit tricky. And this is where I continue to plead and advocate for marketers because again, in many ways, sometimes we're the only voice of the consumer inside of our
[47:27] organizations. Okay. accountable that if something bad happens, um we have a way of address redress. So, we have a way of repairing
[47:42] maybe a damaged relationship with the consumer. And so, I'm curious if the challenge we're facing now has to do more with accountability for negative outcomes as opposed to just things don't work.
[48:01] Maybe I'm off topic. I I'm more than happy. This is a really smart group. So, I'm I would agree. Say it again. Well, you said it as opposed to Just finish what you said at the end. Say it again, please.
[48:15] You said opposed to and then I missed it. Oh, sorry. Um I'm curious if we're if it's more important for us to think about accountability as opposed to capability.
[48:29] Ah. Technology always changes. The capabilities are always limited in some dimension. So, is it more that we should be accountable to negative outcomes that
[48:41] maybe faces our consumers? And then how do we protect our firms? And then how do we protect our firms? Oh. technology is incredible. And I think that when you understand what you want
[48:57] and you have a clear purpose, it has a lot of applications. Uh your ethics are your ethics. You know, if if you're an ethical person, you look to use it in the right way. If you're unethical, you look to
[49:13] use it in ways, you know, for whatever purposes that you have. So, that's that's a human problem, not an AI problem. And we need to be able to distinguish that. But AI is a very powerful
[49:26] technology. It has a lot of great applications. It solves a lot of problems and some but sometimes people have the wrong ideas of why they want to use AI. And that's again goes back to the person
[49:41] technology is what it is. It has tremendous capabilities and it And if you want to use it, you have to understand it. I don't understand how the insides of a
[49:54] car work. Mhm. But I'm allowed to have a learner's driver's license. >> And and but but when you get into a car and you you have you you understand what the rules are
[50:10] you you understand what the rules are for that. When you use AI to solve for that. When you use AI to solve problems, you also have to understand you know, and not take whatever comes out of it and
[50:22] understand what the results are. That's your responsibility your responsibility to take the data and do something with Right? You don't have to understand interpretability and inference and
[50:35] hallucination, but you do have to understand that everything that comes out of it is not gospel and you should use it, you know, carefully. How you use it, that's your responsibility. That's not AI's responsibility.
[50:49] Oh, so the responsibility of any negative outcome, the accountability for any negative outcome is at the individual user. Not at the firm. >> You you are you are responsible for your own actions and your own
[51:03] thoughts. Well, I mean this and and this I mean it would be actually a fascinating day for another section cuz we're almost at time here, but but even I mean I think the car example is a good one cuz we see examples where most of
[51:16] the time someone goes and and kills or hurts another person with a car, it's going to be the driver's fault. But there are times when an airbag doesn't deploy, the brakes don't work as
[51:32] doesn't deploy, the brakes don't work as planned. And sometimes that's actually a whole system-wide recall of tons of vehicles because there was
[51:44] something done at the manufacturer level that was either an oversight or came up after the fact and and and any harm that's done for that winds up clearly
[51:58] their fault and they have to also prevent any harm from happening even if it hasn't happened yet. So having this dichotomy of when harm comes from the manufacturers, in this case the OpenAIs and Metas and
[52:13] of the world that that seem to have carte blanche to have some cars with some pretty wobbly wheels come and out there. It's a very fast engines and maybe not not enough treads on their tires,
[52:28] but but also like to the other point like I most folks out there, we don't know how to drive yet, right? Like you know, we we're we're just you know, we're still
[52:40] like and if we're driving, we're like driving this 500 power horsepower car on like a dirt gravel road that was not designed for the car. It was designed
[52:52] for the horses that came before it. So so we've got a lot to navigate here. Like I'd love to dive into that further. We don't have as much time here. I hope we can continue this in Slack and in future conversations.
[53:06] future conversations. The participation is fascinating as who's been chiming in and also the chat thread's been tremendous. So thank you all. Dr. Cecilia Downs, I mean just amazing. Look forward to following more
[53:21] here and and you're bringing up so many and and you're bringing up so many important issues for us to follow. special group. You've created a community and the fact
[53:35] that everyone shows up for themselves and each other, it's something special. Well, appreciate you getting to join us for all that and you sharing that. Yeah, thanks everyone. Have a wonderful rest of your week. We'll keep
[53:49] in New York, we've got first Wednesday in person next Wednesday. So be sure to check the event page for that. And yeah, just tremendous slate of speakers ahead. So thanks everyone and
[54:05] speakers ahead. So thanks everyone and see you soon.