Elasticsearch Class Diagram for Shard Routing and Preference

RotationShardShuffler is initialized with a random seed, then the seed will be increased by one (round-robin) on every certain action.

Elasticsearch Memory Mapped File Details

Bibliography

1. mmap
2. Memory-mapped file
3. Memory-mapped I/O
4. Virtual Memory
5. Why not mmap?
6. 10 Things to Know about Memory Mapped File in Java
7. sun.nio.ch.FileChannelImpl.c
8. java.nio.MappedByteBuffer.c
9. Apache Lucene - Index File Formats
10. Use Lucene’s MMapDirectory on 64bit platforms, please!

Elasticsearch class diagram about Searching

Interview with LZ4 (Extremely Fast Compression algorithm)

Why is LZ4 so fast?

1. Fast scan strategy
• xxHash (Extremely fast non-cryptographic hash algorithm)
2. Multi-threading
3. Reduced memory usage fits into Intel x86 L1 cache
• #define LZ4_MEMORY_USAGE 14 (default 16 KB, see lz4.h)

Reference:

1. LZ4 - Improved performance
2. Multi-threading compression available
3. LZ4 explained
4. Lucene source code to learn LZ4 compression algorithm in Lucene

Official site:

1. LZ4 - Extremely fast compression
2. LZ4 Java
1. JNI (fastest)
2. Pure Java
3. Java uses sun.misc.Unsafe API

Elasticsearch and Lucene class diagram about Indexing