From stabilizing consumer goods supply chains, to optimizing airplane manufacturing processes, and monitoring public health outbreaks across the globe, Foundry\u2019s interoperable and extensible architecture<\/a> has enabled data science teams worldwide to readily collaborate with their business and operational teams, enabling all stakeholders to create data-driven impact.<\/p>\n\n\n As we discussed in a previous data science blog post,<\/a> using AI\/ML for these important use cases demands software that spans the entire model lifecycle. Foundry\u2019s first-class security and data quality tools enable users to develop AI\/ML models, and by establishing a trustworthy data<\/a> foundation, our software offers the connectivity and dynamic feedback loops that these teams need in order to sustain the effective use of models in practice.<\/p>\n\n\n\n Further to this, developing capabilities that facilitate the responsible use of artificial intelligence is an indispensable part of building industry-leading AI\/ML<\/a> capabilities. Here, we\u2019ll share more about what responsible AI means at Palantir, and how Foundry\u2019s latest model management and ModelOps<\/a> capabilities enable organizations to address their most challenging problems.<\/p>\n\n\n\n At its core, our AI\/ML product strategy centers around developing software that enables responsible AI use in both collaborative and operational settings. We believe that the term has many dimensions and includes considerations around AI safety, reliability, explainability, and governance. We\u2019ve publicly advocated for a focused, problem-driven approach<\/a> as well as the importance of robust data governance<\/a> to AI\/ML in multiple forums.<\/p>\n\n\n\n We believe that the tenets of responsible AI are not just limited to model development and use but have considerations throughout the entire model lifecycle.<\/a> For example, developing reliable AI\/ML solutions requires tools for the management and curation of high-quality data. These considerations extend beyond model deployment alone and include how end-users interact with their AI outputs and how they can use feedback loops for iteration, monitoring, and long-term maintenance.<\/p>\n\n\n\n Incorporating responsible AI principles in our software is also a core part of our commitment to privacy and civil liberties.<\/a> Building this kind of software means recognizing that AI is not the solution to every problem and that a model for one problem will not always be a solution to others. A model\u2019s intended use should be clearly and transparently scoped to specific business or operational problems.<\/p>\n\n\n\n Moreover, the challenges of using AI for mission-critical problems span a variety of domains and require expertise from a diverse breadth of disciplines. Building AI solutions should therefore be an interdisciplinary process where engineers, domain-experts, data scientists, compliance teams, and other relevant stakeholders work together to ensure the solution represents the specialized demands and requirements of the intended field of application. The values of responsible AI shape how we build our software, and in turn, they enable our customers to use AI\/ML solutions in Foundry for their most critical problems.<\/p>\n\n\n\n Building on the platform\u2019s robust security and data governance tools, Foundry\u2019s model management capabilities are designed to encourage users to incorporate responsible AI principles throughout a model\u2019s lifecycle. We have recently released product capabilities that improve the testing and evaluation ecosystem through no-code and low-code interfaces. We encourage you to read more about these here.<\/a><\/p>\n\n\n\n In Foundry, orienting around the \u201coperational problem\u201d that models are trying to solve is at the heart of this new model management infrastructure. Foundry offers many tools for a data-first and exploratory approach to model experimentation, but for mission-critical use-cases, AI\/ML applications need to be scoped to a specific problem. We have deliberately built modeling objectives<\/a> to focus model development, evaluation, and deployment around well-defined problems.<\/p>\n\n\n\n The Modeling Objectives application enables users to define a problem, develop candidate models as solutions to these challenges, perform large-scale testing and evaluation, deploy models in many modalities to both staging and production applications, and then monitor them to enable faster iteration.<\/p>\n\n\n\n Specifying the modeling problem from the outset enables collaborators to better understand \u2014 and test for \u2014 the application and context for which the models are intended. This also provides greater insight into inadvertent reuse or repurposing of models. Modeling objectives provide a flexible yet structured framework that presents an opportunity to streamline model development and deployment by collecting key datasets, identifying stakeholders, and creating a testing and evaluation plan before their development begins.<\/p>\n\n\n\n These objectives also transparently communicate state about a particular AI\/ML solution \u2014 from model development to testing, to deployment and further post-deployment actions like monitoring and upgrades. This enables users to be more intentional, responsible, and effective in how they use AI to address their organization\u2019s operational challenges. Data protection, governance, and security are core components of Palantir Foundry and are especially important for AI\/ML. AI solutions must be traceable, auditable, and governable in order to be used effectively and responsibly. To facilitate this, Foundry\u2019s model management infrastructure integrates deeply with the platform\u2019s robust capabilities for versioning, branching, lineage, and access control.<\/p>\n\n\n\n Users can submit a model version to an objective and propose that model as a candidate solution for the problem defined in that objective. When submitting a model, users are encouraged to fill out metadata about the submission which becomes part of its permanent record. Project stakeholders and collaborators can use this to better understand the details of each submission and create a system of record that catalogs all future models for a particular modeling problem. With Data Lineage,<\/a> they can also quickly see the provenance of every model that is submitted to an objective, revealing not only the models themselves, but also their training and testing data and what sources those datasets originally came from.<\/p>\n\n\n\n Foundry\u2019s model management infrastructure natively integrates with the platform\u2019s security primitives for access controls. This enables multiple model developers, evaluators, and other stakeholders to work together on the same modeling problem, while maintaining strict security and governance controls.<\/p>\n\n\n\n Testing and evaluation (T&E) is one of the most critical steps in any model\u2019s lifecycle. During T&E, subject matter experts, data scientists, and other business stakeholders determine whether a model is both effective and efficient for any given modeling problem. For example, models may need to be evaluated quantitatively and qualitatively, assessed for bias and fairness concerns, and checked against organizational requirements before they can be deployed to applications in production environments. That\u2019s why we have released a new suite of capabilities<\/a> to facilitate more effective and thorough T& in Foundry.<\/p>\n\n\n\n Foundry now offers evaluation libraries<\/a> for common AI\/ML problems as a part of the Modeling Objectives application. The availability and native integration of these libraries within Foundry\u2019s model management infrastructure enable users to quickly produce well-known, quantitative metrics in a point-and-click fashion for common modeling problems, all without having to dive into any technical implementation.<\/p>\n\n\n\n We\u2019ve also included a framework for users to write their own custom evaluation libraries.<\/a> Libraries authored in this framework benefit from the same UI-driven workflow and integration with modeling objectives. This extends the power of the integrated evaluation framework to more advanced modeling problems or context-specific use cases.<\/p>\n\n\n\n Building on the evaluation library integrations, we\u2019ve also added the ability to easily evaluate models across subsets of data.<\/a> This lets users quickly and exhaustively compute metrics to identify areas of model weakness that might otherwise go undetected if only computing aggregate metrics. Evaluating models on subsets can more easily surface bias or fairness concerns that affect only a portion of the model\u2019s expected data distribution. Users can also configure their T&E workflows to run automatically<\/a> on all candidate models proposed for a problem in order to build a T&E procedure that is both systematic and consistent.<\/p>\n\n\n\n We also recognize that not all T&E procedures are quantitative. Therefore, checks<\/a> in modeling objectives help keep track of certain pre-release tasks that might need to get done as part of the T&E process before a model can be released.<\/p>\n\n\n\n Modeling objectives and the T&E suite are just some of the latest capabilities to encourage responsible AI in Foundry, and we continue to invest in new capabilities for effective model management. From the tools that facilitate robust model evaluation across domains, to mechanisms for seamless model release and rollback in production settings, our model management offering will always focus on empowering our customers to use their AI\/ML solutions effectively, easily, and responsibly for their organization\u2019s most challenging problems.<\/p>\n\n\n\n This post originally appeared on Palantir.com<\/a> and is re-published with permission.<\/p>\n\n\n\n Download our Resource, \u201cPalantir Named a Leader in AI\/ML Platforms\u201d <\/a>to learn more about how Palantir Technologies can support your organization.<\/strong><\/em><\/p>\n<\/head>","protected":false},"excerpt":{"rendered":" Editor’s Notes: The following is a collaboration between authors from Palantir\u2019s Product Development and Privacy & Civil Liberties (PCL) teams. It outlines how our latest model management capabilities incorporate the principles of responsible artificial intelligence so that Palantir Foundry users … Continue reading ![\"Palantir](\"https:\/\/www.carahsoft.com\/wordpress\/wp-content\/uploads\/2024\/09\/Palantir-Responsible-AI-in-Foundry-Blog-Embedded-Image-2023.jpg\")
<\/figure><\/div>\n\n\nResponsible AI at Palantir<\/h2>\n\n\n\n
Model Management in Foundry<\/h2>\n\n\n\n
Problem-first modeling<\/h2>\n\n\n\n
<\/p>\n\n\n\nDeep integrations for security and governance<\/h2>\n\n\n\n
Robust testing and evaluation capabilities<\/h2>\n\n\n\n
Looking ahead<\/h2>\n\n\n\n