FOSS Backstage 2025

From Forks to Sporks: The Journey Behind Creating OpenSearch
2025-03-11 , Auditorium

Go behind the scenes of creating and building OpenSearch—a bold fork of Elasticsearch and Kibana that defied taboos, sparked public drama, and redefined open source governance. This talk dives into the challenges, lessons, and breakthroughs that shaped the project and a journey to balance community, corporate influence, and innovation.


Forking Elasticsearch to create OpenSearch wasn't just a technical challenge—it was a whirlwind of public relations drama, governance hurdles, and community building complexities. OpenSearch was born from a pivotal decision: to fork Elasticsearch and Kibana in response to Elastic's controversial license changes, a move that sent shockwaves through the open source world. At a time when forking was strictly considered taboo, this Herculean effort set the stage for other forks like MapLibre, OpenTofu, and Valkey. In this talk, I'll take you behind the scenes of creating OpenSearch at AWS, from navigating the highly publicized PR storm and addressing concerns of enterprise customers, to ensuring compatibility for users while charting a new path forward.

We'll dive into the unexpected challenges of forking a major open source project: the hidden technical debt, the painstaking work of building trust with a skeptical community, and the balancing act of aligning corporate objectives with open source principles. I'll also discuss the complexities and trade-offs considered when deciding whether to transition OpenSearch to an Open Source Software Foundation—a move the community felt was critical to ensure neutrality and open governance.

But the story doesn't stop there. I'll reflect on my journey leaving AWS to build a startup around the same technology, highlighting what OpenSearch gets right, where it struggles, and why innovation still required stepping outside its framework—culminating in the creation of a "spork," designed to push the boundaries further. This talk is a candid exploration of the good, bad, and ugly of governance in open source: lessons learned, scars earned, and insights into what it really takes to build an open source community that balances the needs of corporations and contributors alike. For anyone navigating the fine line between corporate sponsorship and community ownership, this story is a must-hear.

Dr. Nicholas Knize is a search expert, geospatial technologist, and Apache Lucene Committer and PMC member with over 20 years of experience. As the former Elastic Geospatial Search and Maps Lead and AWS Principal Engineer, Nicholas spearheaded the creation of OpenSearch, a pivotal fork of Elasticsearch. He has decades of experience building and deploying search and analysis systems for Defense and Intelligence industries, designed to operate in resource-constrained and network-starved environments. This deep expertise is now poured into his startup, Lucenia, which advances open source search technology while balancing innovation with the needs of both the community and enterprise.