{"id":19176,"date":"2024-08-19T18:47:01","date_gmt":"2024-08-19T18:47:01","guid":{"rendered":"https:\/\/productcollective.com\/?p=19176"},"modified":"2024-08-20T13:13:34","modified_gmt":"2024-08-20T13:13:34","slug":"ethical-product-management","status":"publish","type":"post","link":"https:\/\/productcollective.com\/ethical-product-management\/","title":{"rendered":"Deep-Dive: Ethical Product Management"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching. From social media platforms that can sway public opinion to AI systems that make decisions affecting millions, the products we build can transform the world\u2014for better or worse.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The growing importance of ethics in product management stems from recognizing that great responsibility comes with great power. <\/span><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\">As product leader, Kasia Chmielinski, aptly put it in their keynote talk at the Virtual edition of INDUSTRY: The Product Conference<\/span><\/a><span style=\"font-weight: 400;\">, &#8220;Digital products can have a significant impact on the users\u2014from saving lives to exposing people to harmful content, encouraging unhealthy habits, and contributing to climate change.&#8221; This stark reality underscores the need for product managers to consider not just what can be built but what should be built.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Key ethical challenges in tech today span a wide spectrum. Data privacy and user consent have become critical concerns in an era of big data and personalized experiences. Algorithmic bias threatens to perpetuate and amplify societal inequalities. The addictive nature of some digital products raises questions about digital well-being and mental health. Environmental sustainability, accessibility, and the implications of AI-driven decision-making add further complexity to the ethical landscape.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In this context, ethical product management emerges as a moral imperative and a crucial factor for long-term success, user trust, and positive societal impact. This essay explores the multifaceted nature of ethical product management, providing frameworks, insights, and practical approaches for navigating this complex terrain.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">By examining the challenges, exploring decision-making frameworks, and exploring ways to build ethical product cultures, we will equip product managers with the tools they need to create products that meet business objectives, uphold ethical standards, and contribute positively to society. In doing so, we pave the way for a future where technology serves humanity&#8217;s best interests, fostering trust, well-being, and progress.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\">Understanding Ethical Product Management<\/span><\/h3>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-19178\" src=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Understanding-Ethical-Product-Management.png\" alt=\"Understanding Ethical Product Management\" width=\"600\" height=\"300\" srcset=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Understanding-Ethical-Product-Management.png 900w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Understanding-Ethical-Product-Management-300x150.png 300w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Understanding-Ethical-Product-Management-768x384.png 768w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">At its essence, ethical product management is creating and maintaining products that meet business goals and prioritize user well-being and broader societal benefits. Roman Pichler eloquently captures this concept, stating, &#8220;<\/span><a href=\"https:\/\/www.romanpichler.com\/blog\/product-ethics\/\"><span style=\"font-weight: 400;\">An ethical product is an offering that does not cause any harm, neither to its users nor the planet.<\/span><\/a><span style=\"font-weight: 400;\">&#8221; This definition sets a high standard, challenging product managers to look beyond mere functionality and profitability to consider the far-reaching implications of their work.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Product managers must navigate a complex landscape fraught with tensions between business objectives and ethical considerations. On one side, there&#8217;s the pressure to generate revenue, meet growth targets, and stay competitive in a fast-paced market. On the other, there&#8217;s an increasing recognition of the profound impact that products can have on individuals and society. This dichotomy forms the core challenge of ethical product management.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In addressing this challenge, several key principles emerge as guideposts for ethical product management. User-centricity sits at the forefront, emphasizing prioritizing genuine user needs and well-being over short-term business gains. Transparency follows closely, calling for openness and honesty about product functionalities, data collection, and usage. Fairness and inclusivity demand that products be accessible and beneficial to diverse user groups, actively working to avoid bias and discrimination.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Privacy and data protection have become increasingly critical in our data-driven world, requiring product managers to handle user information with the utmost respect and responsibility. Environmental sustainability pushes the consideration of ecological impact throughout a product&#8217;s lifecycle. Lastly, social responsibility asks product managers to evaluate and strive for positive societal impact through their products.<\/span><\/p>\n<p><a href=\"https:\/\/www.mindtheproduct.com\/ethical-product-principles-in-practice\/\"><span style=\"font-weight: 400;\">These principles align closely with the approach Josh Hart describes at The Lego Group<\/span><\/a><span style=\"font-weight: 400;\">, where the creation of ethical product principles serves as a compass for decision-making. By embedding these principles into the fabric of product development, teams can more consistently navigate the complex ethical terrain they face.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The role of product managers in this ethical landscape is pivotal. <\/span><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">As AI product leader, John Haggerty, points out<\/span><\/a><span style=\"font-weight: 400;\">, Product managers play a critical role in championing ethical values and promoting a culture of ethical decision-making within the organization. Their unique position, bridging various departments and stakeholders while maintaining a holistic view of the product, places them at the center of ethical decision-making.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This central role requires product managers to balance multiple, often competing, considerations. They must meet business objectives and growth goals while genuinely addressing user needs and improving lives. They need to leverage available technologies responsibly, always considering their decisions&#8217; potential positive and negative impacts. This balancing act demands a strong ethical framework and the ability to make principled decisions, often in the face of conflicting pressures.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To navigate these challenges effectively, product managers must develop a keen ethical sensibility. This involves cultivating deep empathy, truly understanding and considering the perspectives of diverse user groups. It requires developing foresight to anticipate potential ethical issues before they arise. Collaboration becomes crucial, involving engaging with various stakeholders to gain different ethical perspectives. Continuous learning and staying informed about evolving ethical issues in technology and best practices in addressing them are essential.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Moreover, ethical considerations should be embedded into every stage of the product development lifecycle. From ideation and design through development, testing, launch, and ongoing maintenance, ethical thinking should be a constant companion to product decisions.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It&#8217;s crucial to recognize that ethical product management is not a one-time checkbox but an ongoing process. As technologies evolve and societal norms shift, what&#8217;s considered ethical may change. Therefore, product managers must remain vigilant and adaptable, constantly reassessing the ethical implications of their products. By embracing these principles and responsibilities, product managers can lead the way in creating products that succeed in the market and contribute positively to society.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Understanding and implementing ethical product management is no longer optional\u2014it&#8217;s a necessity for creating sustainable, trusted, and truly valuable products. Kasia Chmielinski stresses that it\u2019s important that Product Managers take responsibility for the ramifications of the products they create and make ethically sound product decisions. This responsibility forms the cornerstone of ethical product management, guiding the creation of products that genuinely improve lives while navigating the complex ethical challenges of our digital age.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\">Ethical Challenges in Modern Product Management<\/span><\/h3>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-19179\" src=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Ethical-Challenges-in-Modern-Product-Management.png\" alt=\"Ethical Challenges in Modern Product Management\" width=\"600\" height=\"300\" srcset=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Ethical-Challenges-in-Modern-Product-Management.png 900w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Ethical-Challenges-in-Modern-Product-Management-300x150.png 300w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Ethical-Challenges-in-Modern-Product-Management-768x384.png 768w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">Data privacy and user consent are among the most pressing issues in modern product management. With the increasing sophistication of data collection and analysis techniques, products can gather unprecedented information about their users. While this data can drive personalization and improve user experiences, it also raises significant privacy concerns. <\/span><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">John Haggerty emphasizes the importance of &#8220;informed consent by the user,&#8221;<\/span><\/a><span style=\"font-weight: 400;\"> noting that data collection and usage transparency are crucial for building trust. Product managers must grapple with questions like How much data is necessary to collect? How can we ensure users truly understand what they&#8217;re consenting to? How do we balance personalization with privacy?<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The challenge of data ethics and responsible collection practices is closely related to privacy concerns.<\/span><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\"> Kasia Chmielinski points out that data is the foundation of all AI solutions, no matter what you&#8217;re building<\/span><\/a><span style=\"font-weight: 400;\">. This means that ethical considerations must begin at the data collection stage. Product managers need to consider the legality of their data practices and their ethical implications. This includes ensuring diverse and representative data sets, avoiding biases in data collection, and considering the potential for data misuse or unintended consequences.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The rise of AI and machine learning has introduced a new layer of complexity to product ethics. Algorithmic bias is a significant concern, as AI systems can perpetuate or amplify existing societal biases. For instance, <\/span><a href=\"https:\/\/www.bbc.com\/worklife\/article\/20240214-ai-recruiting-hiring-software-bias-discrimination\"><span style=\"font-weight: 400;\">AI-driven hiring tools have been found to discriminate against certain demographic groups<\/span><\/a><span style=\"font-weight: 400;\">, while <\/span><a href=\"https:\/\/www.scientificamerican.com\/article\/police-facial-recognition-technology-cant-tell-black-people-apart\/\"><span style=\"font-weight: 400;\">facial recognition systems have shown lower accuracy rates for women and people of color<\/span><\/a><span style=\"font-weight: 400;\">. Product managers must be vigilant in identifying and mitigating these biases, which often require looking beyond the code to the underlying data and assumptions that inform AI models.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Transparency in AI-driven products presents another challenge. As AI systems become more complex, their decision-making processes can become opaque, leading to what&#8217;s often referred to as the &#8220;black box&#8221; problem. <\/span><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">John Haggerty stresses the importance of &#8220;being able to explain&#8221; AI systems to users<\/span><\/a><span style=\"font-weight: 400;\">, even in simplified terms. Product managers must find ways to make AI-driven features and decisions more understandable and accountable to users.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The addictive nature of many digital products has also come under scrutiny. Features designed to maximize engagement can sometimes cross the line into exploitative territory, negatively impacting users&#8217; mental health and well-being. <\/span><a href=\"https:\/\/www.romanpichler.com\/blog\/product-ethics\/\"><span style=\"font-weight: 400;\">As Roman Pichler notes<\/span><\/a><span style=\"font-weight: 400;\">, \u201cEngagement then becomes a euphemism for addiction.\u201d Product managers must wrestle with the ethical implications of design choices that may boost key metrics but at the cost of user well-being. This challenge requires a careful balancing act between business goals and ethical considerations.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Accessibility and inclusive design represent another crucial ethical consideration. Products that aren&#8217;t accessible to users with disabilities not only exclude a significant portion of the population but also often fall short of legal requirements. Beyond legal compliance, there&#8217;s an ethical imperative to ensure that products are usable by as wide a range of people as possible. This challenge extends to considerations of cultural inclusivity and avoiding designs that may alienate or marginalize certain groups.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Environmental sustainability is an emerging ethical concern in product management. The environmental impact of digital products, from the energy consumption of data centers to the e-waste generated by hardware, is becoming increasingly apparent. Product managers need to consider the ecological footprint of their products throughout their lifecycle, from development to disposal.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">One of the most complex challenges is keeping humans in the loop throughout the process, especially in AI-driven systems. <\/span><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\">Kasia Chmielinski argues that it&#8217;s crucial to ensure that \u201chumans are doing the things that humans are good at and machines are doing the things that machines are good at.&#8221;<\/span><\/a><span style=\"font-weight: 400;\"> This means designing systems that leverage AI capabilities while still maintaining human oversight and intervention where necessary. It&#8217;s a delicate balance that requires careful consideration of where and how to integrate human judgment into automated processes.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Product managers must grapple with the broader societal implications of their products, too. Technologies like social media platforms have demonstrated the power to influence public opinion, shape social norms, and even impact democratic processes. This level of influence comes with significant ethical responsibilities. Product managers must consider how their product affects individual users and how it might shape society at large.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Navigating these ethical challenges requires awareness, foresight, and principled decision-making. It demands that product managers look beyond immediate metrics and short-term gains to consider the long-term and often unforeseen impacts of their products. As the ethical landscape continues to evolve, staying informed and adaptable will be key to creating products that are not only successful but also ethically sound and socially responsible.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\">Approaches for Ethical Decision-Making in Product Development<\/span><\/h3>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-19180\" src=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Approaches-for-Ethical-Decision-Making-in-Product-Development.png\" alt=\"Approaches for Ethical Decision-Making in Product Development\" width=\"600\" height=\"300\" srcset=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Approaches-for-Ethical-Decision-Making-in-Product-Development.png 900w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Approaches-for-Ethical-Decision-Making-in-Product-Development-300x150.png 300w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Approaches-for-Ethical-Decision-Making-in-Product-Development-768x384.png 768w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">Having robust approaches to decision-making is crucial. These approaches serve as guiding principles, helping product managers navigate the often murky waters of ethical dilemmas and make decisions that align with business objectives and ethical standards.<\/span><\/p>\n<p><a href=\"https:\/\/www.mindtheproduct.com\/ethical-product-principles-in-practice\/\"><span style=\"font-weight: 400;\">Josh Hart emphasizes the importance of team engagement in developing these principles<\/span><\/a><span style=\"font-weight: 400;\">. By involving the entire product team in the process, organizations can ensure that ethical considerations are not just top-down mandates but are woven into the fabric of the product development culture. This collaborative approach helps create principles that resonate with the team and are more likely to be applied in day-to-day decision-making.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Hart&#8217;s approach involves starting discussions within the team about products that have negatively impacted their lives. This exercise helps team members connect personally with the ethical implications of product decisions. From there, the team can identify key ethical concerns relevant to their product and user base. The resulting principles might cover areas such as inclusivity, understanding users&#8217; hardships, or ensuring accessibility for all users.<\/span><\/p>\n<p><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\">Kasia Chmielinski offers another perspective on ethical product development, emphasizing the importance of considering the &#8220;could&#8221; versus &#8220;should&#8221; question<\/span><\/a><span style=\"font-weight: 400;\">. This thought encourages product managers to look beyond what is technically feasible to consider whether a particular feature or product should be developed. It&#8217;s crucial in an age where technological capabilities often outpace ethical considerations.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Implementing ethical practices throughout the product lifecycle is also an important component. This involves incorporating ethical considerations at every stage, from initial ideation to post-launch monitoring. During the design phase, for instance, product managers might employ techniques like ethical impact assessments, similar to privacy impact assessments but broader in scope. These assessments can help identify potential ethical issues early in development when changes are easier and less costly to implement.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ethical considerations in the development and testing phases might involve ensuring diverse representation in user testing groups, conducting thorough bias audits of AI systems, or implementing robust data protection measures. Post-launch, it&#8217;s important to have mechanisms in place for ongoing ethical monitoring and iteration. This might include regular ethical audits, user feedback channels specifically focused on ethical concerns, or cross-functional ethics committees to address emerging issues.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Balancing business objectives with user well-being is one of the most challenging aspects of ethical product management. <\/span><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">John Haggerty talks about the importance of this balance<\/span><\/a><span style=\"font-weight: 400;\">, noting that while meeting business goals is essential, it shouldn&#8217;t come at the cost of compromising ethical principles. One approach for addressing this balance is to consider the concept of &#8220;ethical debt,&#8221; analogous to technical debt in software development. This idea encourages product managers to consider the long-term ethical implications of short-term decisions and proactively allocate resources to address potential ethical issues.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another useful approach is stakeholder mapping with an ethical lens. This involves identifying all stakeholders affected by a product decision\u2014not just users and the business but also potentially impacted communities, the environment, and future generations. By considering this broader range of stakeholders, product managers can make more holistic and ethically sound decisions.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\">Building an Ethical Product Culture<\/span><\/h3>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-19181\" src=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Building-an-Ethical-Product-Culture.png\" alt=\"Building an Ethical Product Culture\" width=\"600\" height=\"300\" srcset=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Building-an-Ethical-Product-Culture.png 900w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Building-an-Ethical-Product-Culture-300x150.png 300w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Building-an-Ethical-Product-Culture-768x384.png 768w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">While approaches and guidelines are essential, truly ethical product management requires fostering a culture where ethical considerations are woven into everyday decision-making. Building such a culture is a multifaceted endeavor that requires commitment at all levels of an organization, from leadership to individual contributors.<\/span><\/p>\n<p><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">John Haggerty believes that product managers are critical in championing ethical values and promoting a culture of ethical decision-making within the organization<\/span><\/a><span style=\"font-weight: 400;\">. This championing starts at the top, with leaders who articulate ethical values and embody them in their actions and decisions. Leaders consistently prioritizing ethical considerations alongside business objectives sends a powerful message throughout the organization.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Creating and implementing ethical guidelines and policies is crucial in building an ethical product culture. However, <\/span><a href=\"https:\/\/www.mindtheproduct.com\/ethical-product-principles-in-practice\/\"><span style=\"font-weight: 400;\">as Josh Hart&#8217;s experience at The Lego Group illustrates<\/span><\/a><span style=\"font-weight: 400;\">, these guidelines are most effective when developed collaboratively rather than <\/span><i><span style=\"font-weight: 400;\">imposed<\/span><\/i><span style=\"font-weight: 400;\"> from above. By involving team members in creating ethical principles, organizations can ensure that these principles resonate with the team and reflect its diverse perspectives. This collaborative approach also helps create a sense of ownership and commitment to ethical practices among team members.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Training and empowering teams to make ethical decisions is another key aspect of building an ethical product culture. This goes beyond simply communicating guidelines; it involves equipping team members with the skills and knowledge needed to navigate complex ethical dilemmas. This might include workshops on ethical reasoning, case studies of ethical challenges in product development, or simulations that allow team members to practice applying ethical principles in realistic scenarios.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Encouraging ethical discussions and debates within the team is crucial for maintaining a vibrant ethical culture. <\/span><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\">As Kasia Chmielinski suggests<\/span><\/a><span style=\"font-weight: 400;\">, product teams should regularly engage in conversations about the ethical implications of their work. This could involve dedicated time in team meetings for ethical reflections or even establishing an &#8220;ethics champion&#8221; role that rotates among team members. By normalizing these discussions, teams can create an environment where ethical concerns are openly voiced and thoughtfully addressed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Integrating ethics into product development is another effective way to build an ethical culture. This might involve adding ethical considerations to product requirement documents, including ethical impact assessments in the design phase, or incorporating ethical metrics into product success criteria. By making ethics a formal part of the development process, organizations can ensure that it&#8217;s not treated as an afterthought but an integral part of product creation.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Creating a culture of accountability is also crucial. This involves celebrating ethical successes and addressing ethical missteps openly and constructively. Ethical lapses should be viewed as opportunities for learning and improvement rather than occasions for blame. This approach encourages transparency and helps build a culture where team members feel safe raising ethical concerns.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A culture that fosters ethical product management can\u2019t be done without being open to learning and iterating accordingly. The ethical landscape in technology is constantly evolving, with new challenges emerging as technologies advance. Organizations need to stay informed about these developments and be willing to evolve their ethical practices accordingly. This might involve regular ethics training updates, subscribing to ethics in technology publications, or participating in industry forums on ethical product development.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Lastly, it&#8217;s important to recognize that building an ethical product culture is an ongoing process, not a one-time initiative. It requires consistent effort, regular reinforcement, and a willingness to grapple with difficult questions. By committing to this process, organizations can create an environment where ethical considerations are not considered constraints but integral components of building successful, sustainable, and socially responsible products.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\">Measuring Ethical Impact and Future Trends<br \/>\n<img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-19182\" src=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Measuring-Ethical-Impact-and-Future-Trends.png\" alt=\"Measuring Ethical Impact and Future Trends\" width=\"600\" height=\"300\" srcset=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Measuring-Ethical-Impact-and-Future-Trends.png 900w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Measuring-Ethical-Impact-and-Future-Trends-300x150.png 300w, https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/Measuring-Ethical-Impact-and-Future-Trends-768x384.png 768w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><br \/>\n<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Emerging technologies and shifting societal expectations are shaping the future landscape of ethical considerations in product development. This dual focus on measurement and future trends is essential for product managers looking to create lasting, positive impact through their work.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Developing ethical KPIs (Key Performance Indicators) and metrics presents a unique challenge. Unlike traditional business metrics, ethical impacts are often qualitative and long-term, making them harder to quantify. However, <\/span><a href=\"https:\/\/my.productcollective.com\/c\/product-leadership\/considering-ethical-product-development-76e13439-12d6-4eb1-973c-477bc4c8e627\"><span style=\"font-weight: 400;\">as Kasia Chmielinski pointedly notes, &#8220;You make what you measure.<\/span><\/a><span style=\"font-weight: 400;\">&#8221; This insight underscores the importance of finding ways to quantify the ethical impact, as these measurements will inevitably shape product decisions.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">One approach to developing ethical metrics is to focus on proxies that indicate ethical behavior or outcomes. For instance, a product team might track the number of user privacy complaints, the frequency of algorithmic bias incidents, or the diversity of user testing groups. While these metrics don&#8217;t capture the full scope of ethical impact, they provide tangible data points that can guide decision-making and highlight areas for improvement.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another method involves creating composite scores that combine various ethical considerations. For example, an &#8220;ethical impact score&#8221; could incorporate data privacy practices, accessibility features, environmental sustainability, and user well-being metrics. While such scores inevitably involve subjectivity in their weighting, they can provide a holistic view of a product&#8217;s ethical standing and facilitate comparisons over time or across different products.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Building and maintaining user trust is another critical aspect of ethical product management that requires careful measurement. Trust is foundational to long-term product success, yet it&#8217;s notoriously difficult to quantify. Some companies have begun experimenting with &#8220;trust indexes&#8221; that combine user surveys, behavioral data, and external reputation metrics to gauge overall trust levels. Regular monitoring of these trust metrics can help product teams identify potential ethical issues early and take corrective action.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While sometimes challenging to measure in the short term, the long-term benefits of ethical practices can significantly impact a company&#8217;s success. These benefits include enhanced brand reputation, increased user loyalty, better talent attraction and retention, and reduced regulatory risks. While these outcomes may not be immediately apparent in quarterly reports, they contribute substantially to a company&#8217;s long-term sustainability and success.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Looking toward the future, several emerging technologies are poised to introduce new ethical considerations for product managers. Artificial General Intelligence (AGI), for instance, raises profound questions about decision-making autonomy and the role of human oversight (back to the \u201ccould vs. should\u201d question that was raised earlier in this essay). Product managers must grapple with the ethical implications of creating products that may have unprecedented levels of autonomy and impact.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The rise of immersive technologies like virtual and augmented reality presents another frontier of ethical challenges. These technologies have the potential to blur the lines between digital and physical experiences, raising new questions about privacy, psychological impact, and the nature of reality itself. Product managers working in these fields must consider creating safe, ethical spaces in virtual environments and managing the potential for addiction or detachment from the physical world.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The evolving regulatory landscape is another crucial factor shaping the future of ethical product management. As governments and international bodies grapple with the rapid pace of technological change, new regulations around data privacy, AI ethics, and digital rights will likely emerge. Product managers must stay ahead of these regulatory trends, not just for compliance reasons, but to ensure their products align with emerging societal expectations of ethical technology.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Lastly, the role of product managers in shaping ethical tech policies is likely to grow. Product managers are uniquely positioned to contribute to policy discussions as the individuals closest to both the technological capabilities and user needs. This might involve participating in industry standards committees, engaging with regulatory bodies, or contributing to public discourse on tech ethics. Product managers can help ensure that future policies are ethically sound and practically implementable by taking an active role in these conversations.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As we look to the future, it&#8217;s clear that ethical considerations will only become more central to product management. The products we create today will shape the world of tomorrow, and with that power comes the responsibility to consider their full ethical implications. By developing robust measurement frameworks and staying attuned to emerging trends, product managers can create a more ethical, sustainable, and human-centered technological future.<\/span><\/p>\n<h3><span style=\"color: #ec3131;\"><b>Summing it all up &#8211; A Call for Ethical Leadership in Product Management<\/b><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Throughout this exploration, we&#8217;ve seen how ethical considerations touch every aspect of product development, from understanding user needs to implementing AI technologies.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The challenges are significant: protecting user privacy, mitigating algorithmic bias, ensuring inclusivity, and considering the broader societal impacts of our products. Yet, as we&#8217;ve discovered, powerful frameworks and strategies are available to help us meet these challenges head-on. By implementing ethical decision-making processes, fostering a culture of ethical awareness, and developing metrics to measure our impact, we can create products that succeed in the market and contribute positively to society.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The future of product management is inextricably linked with ethical considerations. As technologies continue to advance and our products become increasingly integrated into people&#8217;s lives, the responsibility of product managers will only grow. We must stay vigilant, continuously educating ourselves about emerging ethical issues and adapting our practices accordingly.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">But knowledge alone is not enough. The time for action is now. As product managers and leaders, we have the power to shape not just our products but the future of technology and its impact on humanity. This is our call to action:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Commit to embedding ethical considerations into every stage of your product development process.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Foster a culture of ethical awareness within your teams and organizations.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Develop and implement ethical metrics to measure the true impact of your products.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Stay informed about emerging technologies and their ethical implications.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Engage in broader discussions about tech ethics and contribute to shaping ethical standards in our industry.<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">Remember, as John Haggerty emphasized, <\/span><a href=\"https:\/\/youtu.be\/uteX_Nq-J8Q\"><span style=\"font-weight: 400;\">we must stay &#8220;in love with the problem, not the solution.&#8221;<\/span><\/a><span style=\"font-weight: 400;\"> By focusing on our users&#8217; genuine needs and the ethical implications of our work, we can create products that truly make a positive difference.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The future of ethical product management is in our hands. Let&#8217;s build it together.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching. From [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":19183,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"image","meta":{"om_disable_all_campaigns":false,"inline_featured_image":false,"footnotes":""},"categories":[372],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference<\/title>\n<meta name=\"description\" content=\"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/productcollective.com\/ethical-product-management\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"og:description\" content=\"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/productcollective.com\/ethical-product-management\/\" \/>\n<meta property=\"og:site_name\" content=\"Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/productcollective\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-19T18:47:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-20T13:13:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"854\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Mike Belsito\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mike Belsito\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/\",\"url\":\"https:\/\/productcollective.com\/ethical-product-management\/\",\"name\":\"Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference\",\"isPartOf\":{\"@id\":\"https:\/\/productcollective.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg\",\"datePublished\":\"2024-08-19T18:47:01+00:00\",\"dateModified\":\"2024-08-20T13:13:34+00:00\",\"author\":{\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/24d4c079e1398ba4f15e5f82e613f5ff\"},\"description\":\"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.\",\"breadcrumb\":{\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/productcollective.com\/ethical-product-management\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage\",\"url\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg\",\"contentUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg\",\"width\":1280,\"height\":854},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/productcollective.com\/ethical-product-management\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/productcollective.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deep-Dive: Ethical Product Management\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/productcollective.com\/#website\",\"url\":\"https:\/\/productcollective.com\/\",\"name\":\"Product Collective | Organizers of INDUSTRY: The Product Conference\",\"description\":\"For people who build, launch and scale world-class software products.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/productcollective.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/24d4c079e1398ba4f15e5f82e613f5ff\",\"name\":\"Mike Belsito\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/mikebelsito-12-150x150.jpg\",\"contentUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/mikebelsito-12-150x150.jpg\",\"caption\":\"Mike Belsito\"},\"description\":\"Mike Belsito is a startup product and business developer who loves creating something from nothing. Mike is the Co-Founder of Product Collective which organizes INDUSTRY, one of the largest product management summits anywhere in the world. For his leadership at Product Collective, Mike was named one of the Top 40 influencers in the field of Product Management. Mike also serves as a Faculty member of Case Western Reserve University in the department of Design and Innovation, and is Co-Host of one of the top startup podcasts online, Rocketship.FM. Prior to Product Collective, Mike spent the past 12 years in startup companies as an early employee, Co-Founder, and Executive. Mike's businesses and products have been featured in national media outlets such as the New York Times, The Atlantic, CNN, NPR, and elsewhere. Mike is also the Author of Startup Seed Funding for the Rest of us, one of the top startup books on Amazon.\",\"sameAs\":[\"https:\/\/twitter.com\/belsito\"],\"url\":\"https:\/\/productcollective.com\/author\/mikebelsito\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference","description":"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/productcollective.com\/ethical-product-management\/","og_locale":"en_US","og_type":"article","og_title":"Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference","og_description":"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.","og_url":"https:\/\/productcollective.com\/ethical-product-management\/","og_site_name":"Product Collective | Organizers of INDUSTRY: The Product Conference","article_publisher":"https:\/\/www.facebook.com\/productcollective","article_published_time":"2024-08-19T18:47:01+00:00","article_modified_time":"2024-08-20T13:13:34+00:00","og_image":[{"width":1280,"height":854,"url":"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg","type":"image\/jpeg"}],"author":"Mike Belsito","twitter_misc":{"Written by":"Mike Belsito","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/productcollective.com\/ethical-product-management\/","url":"https:\/\/productcollective.com\/ethical-product-management\/","name":"Deep-Dive: Ethical Product Management - Product Collective | Organizers of INDUSTRY: The Product Conference","isPartOf":{"@id":"https:\/\/productcollective.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage"},"image":{"@id":"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage"},"thumbnailUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg","datePublished":"2024-08-19T18:47:01+00:00","dateModified":"2024-08-20T13:13:34+00:00","author":{"@id":"https:\/\/productcollective.com\/#\/schema\/person\/24d4c079e1398ba4f15e5f82e613f5ff"},"description":"With the pace of tech moving like no other time in history, product managers find themselves at the intersection of innovation, business objectives, and ethical responsibility. As digital products become increasingly integrated into our daily lives, shaping behaviors and influencing societies, the ethical implications of these creations have never been more profound or far-reaching.","breadcrumb":{"@id":"https:\/\/productcollective.com\/ethical-product-management\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/productcollective.com\/ethical-product-management\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/ethical-product-management\/#primaryimage","url":"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg","contentUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2024\/08\/geese-1990202_1280.jpg","width":1280,"height":854},{"@type":"BreadcrumbList","@id":"https:\/\/productcollective.com\/ethical-product-management\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/productcollective.com\/"},{"@type":"ListItem","position":2,"name":"Deep-Dive: Ethical Product Management"}]},{"@type":"WebSite","@id":"https:\/\/productcollective.com\/#website","url":"https:\/\/productcollective.com\/","name":"Product Collective | Organizers of INDUSTRY: The Product Conference","description":"For people who build, launch and scale world-class software products.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/productcollective.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/productcollective.com\/#\/schema\/person\/24d4c079e1398ba4f15e5f82e613f5ff","name":"Mike Belsito","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/#\/schema\/person\/image\/","url":"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/mikebelsito-12-150x150.jpg","contentUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/mikebelsito-12-150x150.jpg","caption":"Mike Belsito"},"description":"Mike Belsito is a startup product and business developer who loves creating something from nothing. Mike is the Co-Founder of Product Collective which organizes INDUSTRY, one of the largest product management summits anywhere in the world. For his leadership at Product Collective, Mike was named one of the Top 40 influencers in the field of Product Management. Mike also serves as a Faculty member of Case Western Reserve University in the department of Design and Innovation, and is Co-Host of one of the top startup podcasts online, Rocketship.FM. Prior to Product Collective, Mike spent the past 12 years in startup companies as an early employee, Co-Founder, and Executive. Mike's businesses and products have been featured in national media outlets such as the New York Times, The Atlantic, CNN, NPR, and elsewhere. Mike is also the Author of Startup Seed Funding for the Rest of us, one of the top startup books on Amazon.","sameAs":["https:\/\/twitter.com\/belsito"],"url":"https:\/\/productcollective.com\/author\/mikebelsito\/"}]}},"_links":{"self":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/19176"}],"collection":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/comments?post=19176"}],"version-history":[{"count":0,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/19176\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media\/19183"}],"wp:attachment":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media?parent=19176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/categories?post=19176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/tags?post=19176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}