apache · Trending

apache/paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

View on GitHub Website / Demo Back to listing

3.4kstars 1.4kforks 100+contributors Java

README.md

View on GitHub

![Paimon](https://github.com/apache/paimon/blob/master/docs/static/paimon-simple.png)

[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)
[![Get on Slack](https://img.shields.io/badge/slack-join-orange.svg)](https://the-asf.slack.com/archives/C053Q2NCW8G)

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark 
for both streaming and batch operations. Paimon innovatively combines lake format and LSM structure, bringing realtime 
streaming updates into the lake architecture.

Background and documentation are available at https://paimon.apache.org

`Paimon`'s former name was `Flink Table Store`, developed from the Flink community. The architecture refers to some 
design concepts of Iceberg. Thanks to Apache Flink and Apache Iceberg.

## Collaboration

Paimon tracks issues in GitHub and prefers to receive contributions as pull requests.

## Mailing Lists

<table class="table table-striped">
 <thead>
 <th class="text-center">Name</th>
 <th class="text-center">Subscribe</th>
 <th class="text-center">Digest</th>
 <th class="text-center">Unsubscribe</th>
 <th class="text-center">Post</th>
 <th class="text-center">Archive</th>
 </thead>
 <tr>
 <td>
 user@paimon.apache.org 
 User support and questions mailing list
 </td>
 <td class="text-center"> <a href="mailto:user-subscribe@paimon.apache.org">Subscribe</a></td>
 <td class="text-center"> <a href="mailto:user-digest-subscribe@paimon.apache.org">Subscribe</a></td>
 <td class="text-center"> <a href="mailto:user-unsubscribe@paimon.apache.org">Unsubscribe</a></td>
 <td class="text-center"> <a href="mailto:user@paimon.apache.org">Post</a></td>
 <td class="text-center">
 <a href="https://lists.apache.org/list.html?user@paimon.apache.org">Archives</a>
 </td>
 </tr>
 <tr>
 <td>
 dev@paimon.apache.org 
 Development related discussions
 </td>
 <td class="text-center"> <a href="mailto:dev-subscribe@paimon.apache.org">Subscribe</a></td>
 <td class="text-center"> <a href="mailto:dev-digest-subscribe@paimon.apache.org">Subscribe</a></td>
 <td class="text-center"> <a href="mailto:dev-unsubscribe@paimon.apache.org">Unsubscribe</a></td>
 <td class="text-center"> <a href="mailto:dev@paimon.apache.org">Post</a></td>
 <td class="text-center">
 <a href="https://lists.apache.org/list.html?dev@paimon.apache.org">Archives</a>
 </td>
 </tr>
</table>

Please make sure you are subscribed to the mailing list you are posting to! If you are not subscribed to the mailing list, your message will either be rejected (dev@ list) or you won't receive the response (user@ list).

## Slack

You can join the Paimon community on Slack. Paimon channel is in ASF Slack workspace.

- Anyone with an @apache.org email address can become a full member of the ASF Slack workspace.
  Search [Paimon channel](https://the-asf.slack.com/archives/C053Q2NCW8G) and join it.
- If you don't have an @apache.org email address, you can email to `user@paimon.apache.org` to apply for an
  [ASF Slack invitation](https://infra.apache.org/slack.html). Then join [Paimon channel](https://the-asf.slack.com/archives/C053Q2NCW8G).

## Building

JDK 8/11 is required for building the project. Maven version >=3.6.3.

- Run the `mvn clean install -DskipTests` command to build the project.
- Run the `mvn spotless:apply` to format the project (both Java and Scala).
- IDE: Mark `paimon-common/target/generated-sources/antlr4` as Sources Root.

## How to Contribute

[Contribution Guide](https://paimon.apache.org/docs/master/project/contributing/).

## License

The code in this repository is licensed under the [Apache Software License 2](LICENSE).

Repository info

Default branch: master
Latest version: release-2.1.0
Created: 2022-01-12
Last activity: 2026-10-13
License: Apache-2.0
Open issues: 773
Watchers: 70

Topics

big-data data-ingestion flink paimon real-time-analytics spark streaming-datalake table-store

Contributors

JingsongLi

2.2k contributions

yuzelin

432 contributions

Zouxxyy

403 contributions

leaves12138

359 contributions

XiaoHongbo-Hope

321 contributions