Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposal: remove HybridLogStorage and LogitLogStorage #914

Open
killme2008 opened this issue Dec 6, 2022 · 2 comments
Open

Proposal: remove HybridLogStorage and LogitLogStorage #914

killme2008 opened this issue Dec 6, 2022 · 2 comments

Comments

@killme2008
Copy link
Contributor

Looks like RocksDB 7.7.3 has a better performance when compaction happens, and we don't have any plan or resource to improve LogitLogStorage and HybridLogStorage.

I don't know if there are any users using these two implementations, we can remove them if not.

And maybe consider removing RocksDBSegmentLogStorage too.

@Excpt0r
Copy link

Excpt0r commented Mar 31, 2023

Hi @killme2008,
I was just about to file a bug (including a possible solution) for the HybridLogStorage and stumbled across this ticket.

  • I switched from default rocksDB to HybridLogJRaftServiceFactory, because rocksDB has binary dependencies that were not fulfilled by my base container image (switched to alpine). Using the java-log-storage-impl extension looked like a good idea to reduce dependencies.
  • Actually I use jraft only for a fast and reliable leader election implementation. So I guess for that use case, no storage would be needed at all (in fact I delete and re-create the dataPath directory at startup). I gave a small try to implement an empty dummy DefaultJRaftServiceFactory, but jraft-core does some consistency checks on the log contents.

So if I understand correctly, LogitLogStorage will not be the "new" storage format, instead rocksdb will be kept?
Any suggestion on the best approach, if only leader election is needed?

Thanks for your help.

@Excpt0r
Copy link

Excpt0r commented May 11, 2023

@killme2008 @fengjiachun any news on that topic?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants