Brigitte Krenn is starting a new R&D service project: Scientific preparation of a federal large-scale language model.
The study addresses technological and societal aspects (legal, ethical and ecological) of various cases of the implementation of a Bundes-LLM, including: foundation model training and adaptation, fine-tuning of existing LLMs (third party models or one's own base model) to the application needs of individual stakeholders, LLM-based platforms such as RAG systems, and their adaptation to the application needs of individual stakeholders. Sovereignty-First Implementations entirely based on-premises infrastructure, with all data processed and stored within national borders and Hybrid Flexibility Models where sensitive data are processed on-premises, while public services are delivered through a secure cloud environment, and Ecosystem Partnerships based on the collaboration with European AI initiatives to share resources and expertise, reducing R&D costs and accelerating capability transfer.
The outcome of the study is designed to provide a robust, lawful and ethical foundation for decision-makers regarding the development and deployment of a Bundes-LLM for public administration, also taking into account the potential for applications in industry and businesses. The study will clarify key questions and inform strategic choices regarding professional requirements engineering for diverse user groups, ensuring data and technology sovereignty through legal, sustainable and ethical integration, project development, management, and operation in the public interest, cost efficiency through opensource components. Roadmaps for the different usecases and policy implementation recommendations are provided.
For more details see the project website (in German).
