Listary not responsing

Jan_Tichy · November 7, 2024, 11:41pm

Hello Team,
i would like to report the issue for v6.3.0.78. Listary is freezing with the message inside the log file.
I need to kill the process and start again.

2024-11-06 11:07:56.266 [30][Info] [Listary.Core.Utils.] Error staring process C:\Users\tichy\OneDrive\Desktop\vmware.lnk. System.ComponentModel.Win32Exception (0x80004005): The operation was canceled by the user
   at System.Diagnostics.Process.StartWithShellExecuteEx(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start(ProcessStartInfo startInfo)
   at Listary.Core.Utils..(String ) in <6obXaEfspcFFeiz6TldrXfdIggtopu4QDwTQfX9WvYFKV6ewa7rkJzcvoUFum3vBu4SaYkjBcoPos5axP4AjpQ==>:line 25
2024-11-06 11:08:53.716 [21][Info] [Listary.Core.Utils.] Error staring process C:\Users\tichy\OneDrive\Desktop\vmware.lnk. System.ComponentModel.Win32Exception (0x80004005): The operation was canceled by the user
   at System.Diagnostics.Process.StartWithShellExecuteEx(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start(ProcessStartInfo startInfo)
   at Listary.Core.Utils..(String ) in <6obXaEfspcFFeiz6TldrXfdIggtopu4QDwTQfX9WvYFKV6ewa7rkJzcvoUFum3vBu4SaYkjBcoPos5axP4AjpQ==>:line 25
2024-11-06 11:14:08.032 [3][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 11:14:17.570 [7][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 11:14:18.361 [24][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 11:14:47.537 [28][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 14:29:35.910 [30][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 18:40:59.531 [62][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-06 18:40:59.552 [62][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-07 09:53:54.036 [1][Warn] [Listary.Core.] Get icon for C:\Users\tichy\AppData\Local\Microsoft\Outlook\BITE15.tmp False with non zero result but empty hIcon.
2024-11-07 09:53:54.050 [1][Warn] [Listary.Core.] Get icon for C:\Users\tichy\AppData\Local\Microsoft\Outlook\BITFEB.tmp False with non zero result but empty hIcon.
2024-11-07 11:07:10.907 [30][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-07 19:38:33.635 [3][Info] [Listary.Core.Utils.] Error staring process C:\Users\tichy\OneDrive\Desktop\vmware.lnk. System.ComponentModel.Win32Exception (0x80004005): The operation was canceled by the user
   at System.Diagnostics.Process.StartWithShellExecuteEx(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start(ProcessStartInfo startInfo)
   at Listary.Core.Utils..(String ) in <6obXaEfspcFFeiz6TldrXfdIggtopu4QDwTQfX9WvYFKV6ewa7rkJzcvoUFum3vBu4SaYkjBcoPos5axP4AjpQ==>:line 25
2024-11-07 19:47:29.886 [26][Info] [Listary.Core.Utils.] Error staring process C:\Users\tichy\OneDrive\Desktop\vmware.lnk. System.ComponentModel.Win32Exception (0x80004005): The operation was canceled by the user
   at System.Diagnostics.Process.StartWithShellExecuteEx(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start(ProcessStartInfo startInfo)
   at Listary.Core.Utils..(String ) in <6obXaEfspcFFeiz6TldrXfdIggtopu4QDwTQfX9WvYFKV6ewa7rkJzcvoUFum3vBu4SaYkjBcoPos5axP4AjpQ==>:line 25
2024-11-07 19:55:16.097 [20][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-07 20:29:58.667 [14][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-07 20:29:58.667 [14][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")
2024-11-08 00:38:45.243 [4][Warn] [Listary.Core.] Grpc.Core.RpcException: Status(StatusCode="Cancelled", Detail="Call canceled by the client.", DebugException="System.OperationCanceledException: The operation was canceled.")

ListaryMiniCoreLog.txt

[10-22][11:14:37] WARN listary_core::indexed_search::service: Failed to process file changes, indexer 0 is not ready
[10-24][16:48:06] WARN listary_core::db::file_db: Error count exceeds the threshold (800), the index will be forced to rebuild at next start
[10-24][20:29:13] WARN listary_core::db::file_db: Error count exceeds the threshold (810), the index will be forced to rebuild at next start
[10-24][20:29:13] WARN listary_core::indexer::notify: Failed to watch self.root=“P:” e=Error { kind: Generic(“Input watch path is neither a file nor a directory.”), paths: }
[10-25][14:48:16] WARN listary_core::db::file_db: Error count exceeds the threshold (838), the index will be forced to rebuild at next start
[10-25][16:09:28] WARN listary_core::db::file_db: Error count exceeds the threshold (858), the index will be forced to rebuild at next start
[10-25][16:09:28] WARN listary_core::indexer::notify: Failed to watch self.root=“P:” e=Error { kind: Generic(“Input watch path is neither a file nor a directory.”), paths: }
[10-25][19:15:26] WARN listary_core::db::file_db: Error count exceeds the threshold (858), the index will be forced to rebuild at next start
[10-25][19:15:27] WARN listary_core::indexer::notify: Failed to watch self.root=“P:” e=Error { kind: Generic(“Input watch path is neither a file nor a directory.”), paths: }
[10-30][17:56:54] WARN listary_core::db::file_db: Error count exceeds the threshold (1573), the index will be forced to rebuild at next start
[11-01][15:27:51] WARN listary_core::indexer::notify: Failed to watch self.root=“P:” e=Error { kind: Generic(“Input watch path is neither a file nor a directory.”), paths: }
[11-04][09:45:42] WARN listary_core::indexer::notify: Failed to watch self.root=“P:” e=Error { kind: Generic(“Input watch path is neither a file nor a directory.”), paths: }
[11-05][08:44:05] WARN listary_core::db::file_db: Error count exceeds the threshold (747), the index will be forced to rebuild at next start
[11-06][08:03:34] WARN listary_core::db::file_db: Error count exceeds the threshold (1924), the index will be forced to rebuild at next start
[11-06][09:20:22] WARN listary_core::db::file_db: Error count exceeds the threshold (2082), the index will be forced to rebuild at next start
[11-06][11:04:50] WARN listary_core::db::file_db: Error count exceeds the threshold (2124), the index will be forced to rebuild at next start
[11-06][13:19:53] WARN listary_core::db::file_db: Error count exceeds the threshold (2154), the index will be forced to rebuild at next start
[11-07][06:54:26] WARN listary_core::db::file_db: Error count exceeds the threshold (2312), the index will be forced to rebuild at next start
[11-07][09:39:17] WARN listary_core::db::file_db: Error count exceeds the threshold (2330), the index will be forced to rebuild at next start
[11-07][10:46:28] WARN listary_core::db::file_db: Error count exceeds the threshold (2334), the index will be forced to rebuild at next start
[11-07][11:23:21] WARN listary_core::db::file_db: Error count exceeds the threshold (2407), the index will be forced to rebuild at next start
[11-07][15:34:33] WARN listary_core::db::file_db: Error count exceeds the threshold (2413), the index will be forced to rebuild at next start
[11-07][22:12:47] WARN listary_core::db::file_db: Error count exceeds the threshold (2898), the index will be forced to rebuild at next start

Thank you
Best regards,
Jan

Jan_Tichy · November 7, 2024, 11:43pm

LOG.OLD
2024/11/07-11:23:20.899294 2024/11/07-11:23:20.899912 2024/11/07-11:23:20.899930 2024/11/07-11:23:20.899939 2024/11/07-11:23:20.910169 2024/11/07-11:23:20.910200 2024/11/07-11:23:20.910264 2024/11/07-11:23:20.910273 2024/11/07-11:23:20.910283 2024/11/07-11:23:20.911294 7c58 2024/11/07-11:23:20.911307 7c58 2024/11/07-11:23:20.911313 7c58 2024/11/07-11:23:20.911318 7c58 2024/11/07-11:23:20.911323 7c58 2024/11/07-11:23:20.911335 7c58 2024/11/07-11:23:20.911340 7c58 2024/11/07-11:23:20.911346 7c58 2024/11/07-11:23:20.911351 7c58 2024/11/07-11:23:20.911356 7c58 2024/11/07-11:23:20.911360 7c58 2024/11/07-11:23:20.911365 7c58 2024/11/07-11:23:20.911369 7c58 2024/11/07-11:23:20.911374 7c58 2024/11/07-11:23:20.911379 7c58 2024/11/07-11:23:20.911384 7c58 2024/11/07-11:23:20.911388 7c58 2024/11/07-11:23:20.911393 7c58 2024/11/07-11:23:20.911398 7c58 2024/11/07-11:23:20.911402 7c58 2024/11/07-11:23:20.911407 7c58 2024/11/07-11:23:20.911411 7c58 2024/11/07-11:23:20.911416 7c58 2024/11/07-11:23:20.911420 7c58 2024/11/07-11:23:20.911425 7c58 2024/11/07-11:23:20.911429 7c58 2024/11/07-11:23:20.911434 7c58 2024/11/07-11:23:20.911438 7c58 2024/11/07-11:23:20.911443 7c58 2024/11/07-11:23:20.911448 7c58 2024/11/07-11:23:20.911452 7c58 2024/11/07-11:23:20.911457 7c58 2024/11/07-11:23:20.911461 7c58 2024/11/07-11:23:20.911466 7c58 2024/11/07-11:23:20.911470 7c58 2024/11/07-11:23:20.911475 7c58 2024/11/07-11:23:20.911480 7c58 2024/11/07-11:23:20.911484 7c58 2024/11/07-11:23:20.911533 7c58 2024/11/07-11:23:20.911541 7c58 2024/11/07-11:23:20.911544 7c58 2024/11/07-11:23:20.911547 7c58 2024/11/07-11:23:20.911549 7c58 2024/11/07-11:23:20.911552 7c58 2024/11/07-11:23:20.911554 7c58 2024/11/07-11:23:20.911557 7c58 2024/11/07-11:23:20.911560 7c58 2024/11/07-11:23:20.911562 7c58 2024/11/07-11:23:20.911565 7c58 2024/11/07-11:23:20.911567 7c58 2024/11/07-11:23:20.911570 7c58 2024/11/07-11:23:20.911573 7c58 2024/11/07-11:23:20.911575 7c58 2024/11/07-11:23:20.911578 7c58 2024/11/07-11:23:20.911580 7c58 2024/11/07-11:23:20.911583 7c58 2024/11/07-11:23:20.911585 7c58 2024/11/07-11:23:20.911588 7c58 2024/11/07-11:23:20.911591 7c58 2024/11/07-11:23:20.911593 7c58 2024/11/07-11:23:20.911596 7c58 2024/11/07-11:23:20.911599 7c58 2024/11/07-11:23:20.911601 7c58 2024/11/07-11:23:20.911604 7c58 2024/11/07-11:23:20.911606 7c58 2024/11/07-11:23:20.911609 7c58 2024/11/07-11:23:20.911612 7c58 2024/11/07-11:23:20.911614 7c58 2024/11/07-11:23:20.911617 7c58 2024/11/07-11:23:20.911619 7c58 2024/11/07-11:23:20.911622 7c58 2024/11/07-11:23:20.911624 7c58 2024/11/07-11:23:20.911627 7c58 2024/11/07-11:23:20.911630 7c58 2024/11/07-11:23:20.911632 7c58 2024/11/07-11:23:20.911635 7c58 2024/11/07-11:23:20.911637 7c58 2024/11/07-11:23:20.911640 7c58 2024/11/07-11:23:20.911642 7c58 2024/11/07-11:23:20.911645 7c58 2024/11/07-11:23:20.911648 7c58 2024/11/07-11:23:20.911650 7c58 2024/11/07-11:23:20.911653 7c58 2024/11/07-11:23:20.911655 2024/11/07-11:23:20.911661 2024/11/07-11:23:20.911664 2024/11/07-11:23:20.911666 2024/11/07-11:23:20.911669 2024/11/07-11:23:20.911672 2024/11/07-11:23:20.911684 2024/11/07-11:23:20.911687 2024/11/07-11:23:20.911690 2024/11/07-11:23:20.911695 2024/11/07-11:23:20.911697 2024/11/07-11:23:20.912420 :5662] Recovering from 2024/11/07-11:23:20.912574 2024/11/07-11:23:20.912579 7c58 2024/11/07-11:23:20.912582 7c58 2024/11/07-11:23:20.912585 7c58 2024/11/07-11:23:20.912588 7c58 2024/11/07-11:23:20.912590 7c58 2024/11/07-11:23:20.912593 7c58 2024/11/07-11:23:20.912595 7c58 2024/11/07-11:23:20.912631 7c58 cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_w pin_l0_filter_and_index_blocks_in_cache: pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: checksum: 4
no_block_cache: 0
block_cache: 000001CE16A1C750
block_cache_name: LRUCache
block_cache_options:
capacity : 8388608
num_shard_bits : 4
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.000
low_pri_pool_ratio: 0.000
persistent_cache: 0000000000000000
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2024/11/07-11:23:20.912634 7c58 2024/11/07-11:23:20.912637 7c58 2024/11/07-11:23:20.912639 7c58 2024/11/07-11:23:20.912642 7c58 2024/11/07-11:23:20.912644 7c58 2024/11/07-11:23:20.912647 7c58 2024/11/07-11:23:20.912650 7c58 2024/11/07-11:23:20.912652 7c58 2024/11/07-11:23:20.912655 7c58 2024/11/07-11:23:20.912657 7c58 2024/11/07-11:23:20.912660 7c58 2024/11/07-11:23:20.912662 7c58 2024/11/07-11:23:20.912665 7c58 2024/11/07-11:23:20.912668 7c58 2024/11/07-11:23:20.912670 7c58 2024/11/07-11:23:20.912674 7c58 2024/11/07-11:23:20.912678 7c58 2024/11/07-11:23:20.912681 7c58 2024/11/07-11:23:20.912683 7c58 2024/11/07-11:23:20.912686 7c58 2024/11/07-11:23:20.912689 7c58 2024/11/07-11:23:20.912691 7c58 2024/11/07-11:23:20.912694 7c58 2024/11/07-11:23:20.912697 7c58 2024/11/07-11:23:20.912699 7c58 2024/11/07-11:23:20.912702 7c58 2024/11/07-11:23:20.912704 7c58 2024/11/07-11:23:20.912707 7c58 2024/11/07-11:23:20.912709 7c58 2024/11/07-11:23:20.912712 7c58 2024/11/07-11:23:20.912714 7c58 2024/11/07-11:23:20.912717 7c58 2024/11/07-11:23:20.912720 7c58 2024/11/07-11:23:20.912722 7c58 2024/11/07-11:23:20.912725 2024/11/07-11:23:20.912727 7c58 2024/11/07-11:23:20.912730 2024/11/07-11:23:20.912733 2024/11/07-11:23:20.912736 2024/11/07-11:23:20.912738 2024/11/07-11:23:20.912741 2024/11/07-11:23:20.912743 2024/11/07-11:23:20.912746 2024/11/07-11:23:20.912749 7c58 2024/11/07-11:23:20.912751 7c58 2024/11/07-11:23:20.912754 7c58 2024/11/07-11:23:20.912756 7c58 2024/11/07-11:23:20.912759 7c58 2024/11/07-11:23:20.912761 7c58 2024/11/07-11:23:20.912764 7c58 2024/11/07-11:23:20.912767 7c58 2024/11/07-11:23:20.912771 7c58 2024/11/07-11:23:20.912774 2024/11/07-11:23:20.912777 2024/11/07-11:23:20.912779 2024/11/07-11:23:20.912782 2024/11/07-11:23:20.912784 2024/11/07-11:23:20.912787 2024/11/07-11:23:20.912790 2024/11/07-11:23:20.912792 2024/11/07-11:23:20.912813 7c58 2024/11/07-11:23:20.912816 7c58 2024/11/07-11:23:20.912819 7c58 2024/11/07-11:23:20.912822 7c58 2024/11/07-11:23:20.912824 7c58 2024/11/07-11:23:20.912827 7c58 2024/11/07-11:23:20.912829 7c58 2024/11/07-11:23:20.912832 7c58 2024/11/07-11:23:20.912835 7c58 2024/11/07-11:23:20.912837 7c58 2024/11/07-11:23:20.912840 7c58 7c58 RocksDB version: 8.1.1
7c58 Compile date 2023-04-06 16:38:52
7c58 DB SUMMARY
7c58 DB Session ID: YYM7N11YJM1IFX04FP26
7c58 CURRENT file: CURRENT
7c58 IDENTITY file: IDENTITY
7c58 MANIFEST file: MANIFEST-012030 size: 1841 Bytes
7c58 SST files in C:\Users\tichy\AppData\Roaming\Listary\UserProfile\Cache\TICHY-JNT\Index dir, Total Num: 13, files: 011926.sst 011975.sst 012005.sst 012006.sst 012009.sst 012011.sst 012016.sst 012019.sst 012020.sst
7c58 Write Ahead Log file in C:\Users\tichy\AppData\Roaming\Listary\UserProfile\Cache\TICHY-JNT\Index: 012029.log size: 867290 ;
Options.error_if_exists: 0
Options.create_if_missing: 1
Options.paranoid_checks: 1
Options.flush_verify_memtable_count: 1
Options.track_and_verify_wals_in_manifest: 0
Options.verify_sst_unique_id_in_manifest: 1
Options.env: 000001CE16A1C290
Options.fs: WinFS
Options.info_log: 000001CE18D986C0
Options.max_file_opening_threads: 16
Options.statistics: 0000000000000000
Options.use_fsync: 0
Options.max_log_file_size: 0
Options.max_manifest_file_size: 1073741824
Options.log_file_time_to_roll: 0
Options.keep_log_file_num: 1000
Options.recycle_log_file_num: 0
Options.allow_fallocate: 1
Options.allow_mmap_reads: 0
Options.allow_mmap_writes: 0
Options.use_direct_reads: 0
Options.use_direct_io_for_flush_and_compaction: 0
Options.create_missing_column_families: 0
Options.db_log_dir:
Options.wal_dir:
Options.table_cache_numshardbits: 6
Options.WAL_ttl_seconds: 0
Options.WAL_size_limit_MB: 0
Options.max_write_batch_group_size_bytes: 1048576
Options.manifest_preallocation_size: 4194304
Options.is_fd_close_on_exec: 1
Options.advise_random_on_open: 1
Options.db_write_buffer_size: 0
Options.write_buffer_manager: 000001CE16A1C560
Options.access_hint_on_compaction_start: 1
Options.random_access_max_buffer_size: 1048576
Options.use_adaptive_mutex: 0
Options.rate_limiter: 0000000000000000
Options.sst_file_manager.rate_bytes_per_sec: 0
Options.wal_recovery_mode: 2
Options.enable_thread_tracking: 0
Options.enable_pipelined_write: 0
Options.unordered_write: 0
Options.allow_concurrent_memtable_write: 1
Options.enable_write_thread_adaptive_yield: 1
Options.write_thread_max_yield_usec: 100
Options.write_thread_slow_yield_usec: 3
Options.row_cache: None
Options.wal_filter: None
Options.avoid_flush_during_recovery: 0
Options.allow_ingest_behind: 0
Options.two_write_queues: 0
Options.manual_wal_flush: 0
Options.wal_compression: 0
Options.atomic_flush: 0
Options.avoid_unnecessary_blocking_io: 0
Options.persist_stats_to_disk: 0
Options.write_dbid_to_manifest: 0
Options.log_readahead_size: 0
Options.file_checksum_gen_factory: Unknown
Options.best_efforts_recovery: 0
Options.max_bgerror_resume_count: 2147483647
Options.bgerror_resume_retry_interval: 1000000
Options.allow_data_in_errors: 0
Options.db_host_id: hostname
Options.enforce_single_del_contracts: true
Options.max_background_jobs: 2
Options.max_background_compactions: -1
Options.max_subcompactions: 1
Options.avoid_flush_during_shutdown: 0
Options.writable_file_max_buffer_size: 1048576
Options.delayed_write_rate : 16777216
Options.max_total_wal_size: 0
Options.delete_obsolete_files_period_micros: 21600000000
Options.stats_dump_period_sec: 600
Options.stats_persist_period_sec: 600
Options.stats_history_buffer_size: 1048576
Options.max_open_files: -1
Options.bytes_per_sync: 0
Options.wal_bytes_per_sync: 0
Options.strict_bytes_per_sync: 0
Options.compaction_readahead_size: 0
Options.max_background_flushes: -1
7c58 Compression algorithms supported:
7c58 kZSTD supported: 1
7c58 kSnappyCompression supported: 1
7c58 kBZip2Compression supported: 1
7c58 kZlibCompression supported: 1
7c58 kLZ4Compression supported: 1
7c58 kXpressCompression supported: 0
7c58 kLZ4HCCompression supported: 1
7c58 kZSTDNotFinalCompression supported: 1
7c58 Fast CRC32 supported: Not supported on x86
7c58 DMutex implementation: std::mutex
7c58 [to load table properties for file %llu — %s
manifest file: C:\Users\tichy\AppData\Roaming\Listary\UserProfile\Cache\TICHY-JNT\Index/MANIFEST-012030
7c58 [ing flush for any column family internally (non-manual flush) will trigger flushing all column families even if the number of memtables is smaller min_write_buffer_number_to_merge. Therefore, configuring min_write_buffer_number_to_merge > 1 is not compatible and should be satinized to 1. Not doing so will lead to data loss and inconsistent state across multiple column families when WAL is disabled, which is a common setting for atomic flush:621] --------------- Options for column family [default]:
Options.comparator: leveldb.BytewiseComparator
Options.merge_operator: None
Options.compaction_filter: None
Options.compaction_filter_factory: None
Options.sst_partitioner_factory: None
Options.memtable_factory: SkipListFactory
Options.table_factory: BlockBasedTable
table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (000001CE191E0E50)
ith_high_priority: 1
0
0.750000
2
Options.write_buffer_size: 67108864
Options.max_write_buffer_number: 2
Options.compression: Snappy
Options.bottommost_compression: Disabled
Options.prefix_extractor: nullptr
Options.memtable_insert_with_hint_prefix_extractor: nullptr
Options.num_levels: 7
Options.min_write_buffer_number_to_merge: 1
Options.max_write_buffer_number_to_maintain: 0
Options.max_write_buffer_size_to_maintain: 134217728
Options.bottommost_compression_opts.window_bits: -14
Options.bottommost_compression_opts.level: 32767
Options.bottommost_compression_opts.strategy: 0
Options.bottommost_compression_opts.max_dict_bytes: 0
Options.bottommost_compression_opts.zstd_max_train_bytes: 0
Options.bottommost_compression_opts.parallel_threads: 1
Options.bottommost_compression_opts.enabled: false
Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
Options.bottommost_compression_opts.use_zstd_dict_trainer: true
Options.compression_opts.window_bits: -14
Options.compression_opts.level: 32767
Options.compression_opts.strategy: 0
Options.compression_opts.max_dict_bytes: 0
Options.compression_opts.zstd_max_train_bytes: 0
Options.compression_opts.use_zstd_dict_trainer: true
Options.compression_opts.parallel_threads: 1
Options.compression_opts.enabled: false
Options.compression_opts.max_dict_buffer_bytes: 0
Options.level0_file_num_compaction_trigger: 4
Options.level0_slowdown_writes_trigger: 20
Options.level0_stop_writes_trigger: 36
Options.target_file_size_base: 67108864
Options.target_file_size_multiplier: 1
Options.max_bytes_for_level_base: 268435456
7c58 Options.level_compaction_dynamic_level_bytes: 0
Options.max_bytes_for_level_multiplier: 10.000000
7c58 Options.max_bytes_for_level_multiplier_addtl[0]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[1]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[2]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[3]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[4]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[5]: 1
7c58 Options.max_bytes_for_level_multiplier_addtl[6]: 1
Options.max_sequential_skip_in_iterations: 8
Options.max_compaction_bytes: 1677721600
Options.ignore_max_compaction_bytes_for_input: true
Options.arena_block_size: 1048576
Options.soft_pending_compaction_bytes_limit: 68719476736
Options.hard_pending_compaction_bytes_limit: 274877906944
Options.disable_auto_compactions: 0
Options.compaction_style: kCompactionStyleLevel
Options.compaction_pri: kMinOverlappingRatio
7c58 Options.compaction_options_universal.size_ratio: 1
7c58 Options.compaction_options_universal.min_merge_width: 2
7c58 Options.compaction_options_universal.max_merge_width: 4294967295
7c58 Options.compaction_options_universal.max_size_amplification_percent: 200
7c58 Options.compaction_options_universal.compression_size_percent: -1
7c58 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
7c58 Options.compaction_options_fifo.max_table_files_size: 1073741824
7c58 Options.compaction_options_fifo.allow_compaction: 0
Options.table_properties_collectors:
Options.inplace_update_support: 0
Options.inplace_update_num_locks: 10000
Options.memtable_prefix_bloom_size_ratio: 0.000000
Options.memtable_whole_key_filtering: 0
Options.memtable_huge_page_size: 0
Options.bloom_locality: 0
Options.max_successive_merges: 0
Options.optimize_filters_for_hits: 0
Options.paranoid_file_checks: 0
Options.force_consistency_checks: 1

Jan_Tichy · November 7, 2024, 11:44pm

2024/11/07-11:23:20.913453 7c58 Options.max_compaction_bytes: 1677721600
2024/11/07-11:23:20.913456 7c58 Options.ignore_max_compaction_bytes_for_input: true
2024/11/07-11:23:20.913458 7c58 Options.arena_block_size: 1048576
2024/11/07-11:23:20.913461 7c58 Options.soft_pending_compaction_bytes_limit: 68719476736
2024/11/07-11:23:20.913464 7c58 Options.hard_pending_compaction_bytes_limit: 274877906944
2024/11/07-11:23:20.913466 7c58 Options.disable_auto_compactions: 0
2024/11/07-11:23:20.913469 7c58 Options.compaction_style: kCompactionStyleLevel
2024/11/07-11:23:20.913471 7c58 Options.compaction_pri: kMinOverlappingRatio
2024/11/07-11:23:20.913474 7c58 Options.compaction_options_universal.size_ratio: 1
2024/11/07-11:23:20.913476 7c58 Options.compaction_options_universal.min_merge_width: 2
2024/11/07-11:23:20.913479 7c58 Options.compaction_options_universal.max_merge_width: 4294967295
2024/11/07-11:23:20.913482 7c58 Options.compaction_options_universal.max_size_amplification_percent: 200
2024/11/07-11:23:20.913484 7c58 Options.compaction_options_universal.compression_size_percent: -1
2024/11/07-11:23:20.913487 7c58 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2024/11/07-11:23:20.913490 7c58 Options.compaction_options_fifo.max_table_files_size: 1073741824
2024/11/07-11:23:20.913493 7c58 Options.compaction_options_fifo.allow_compaction: 0
2024/11/07-11:23:20.913496 7c58 Options.table_properties_collectors:
2024/11/07-11:23:20.913499 7c58 Options.inplace_update_support: 0
2024/11/07-11:23:20.913501 7c58 Options.inplace_update_num_locks: 10000
2024/11/07-11:23:20.913504 7c58 Options.memtable_prefix_bloom_size_ratio: 0.000000
2024/11/07-11:23:20.913506 7c58 Options.memtable_whole_key_filtering: 0
2024/11/07-11:23:20.913509 7c58 Options.memtable_huge_page_size: 0
2024/11/07-11:23:20.913511 7c58 Options.bloom_locality: 0
2024/11/07-11:23:20.913514 7c58 Options.max_successive_merges: 0
2024/11/07-11:23:20.913516 7c58 Options.optimize_filters_for_hits: 0
2024/11/07-11:23:20.913519 7c58 Options.paranoid_file_checks: 0
2024/11/07-11:23:20.913522 7c58 Options.force_consistency_checks: 1
2024/11/07-11:23:20.913525 7c58 Options.report_bg_io_stats: 0
2024/11/07-11:23:20.913527 7c58 Options.ttl: 2592000
2024/11/07-11:23:20.913530 7c58 Options.periodic_compaction_seconds: 0
2024/11/07-11:23:20.913533 7c58 Options.preclude_last_level_data_seconds: 0
2024/11/07-11:23:20.913535 7c58 Options.preserve_internal_time_seconds: 0
2024/11/07-11:23:20.913538 7c58 Options.enable_blob_files: false
2024/11/07-11:23:20.913540 7c58 Options.min_blob_size: 0
2024/11/07-11:23:20.913543 7c58 Options.blob_file_size: 268435456
2024/11/07-11:23:20.913545 7c58 Options.blob_compression_type: NoCompression
2024/11/07-11:23:20.913548 7c58 Options.enable_blob_garbage_collection: false
2024/11/07-11:23:20.913550 7c58 Options.blob_garbage_collection_age_cutoff: 0.250000
2024/11/07-11:23:20.913553 7c58 Options.blob_garbage_collection_force_threshold: 1.000000
2024/11/07-11:23:20.913556 7c58 Options.blob_compaction_readahead_size: 0
2024/11/07-11:23:20.913558 7c58 Options.blob_file_starting_level: 0
2024/11/07-11:23:20.913561 7c58 Options.experimental_mempurge_threshold: 0.000000
2024/11/07-11:23:20.913593 7c58 [ing flush for any column family internally (non-manual flush) will trigger flushing all column families even if the number of memtables is smaller min_write_buffer_number_to_merge. Therefore, configuring min_write_buffer_number_to_merge > 1 is not compatible and should be satinized to 1. Not doing so will lead to data loss and inconsistent state across multiple column families when WAL is disabled, which is a common setting for atomic flush:621] --------------- Options for column family [db/CustomFolderIndexer/P:]:
2024/11/07-11:23:20.913596 7c58 Options.comparator: leveldb.BytewiseComparator
2024/11/07-11:23:20.913599 7c58 Options.merge_operator: None
2024/11/07-11:23:20.913602 7c58 Options.compaction_filter: None
2024/11/07-11:23:20.913604 7c58 Options.compaction_filter_factory: None
2024/11/07-11:23:20.913607 7c58 Options.sst_partitioner_factory: None
2024/11/07-11:23:20.913609 7c58 Options.memtable_factory: SkipListFactory
2024/11/07-11:23:20.913611 7c58 Options.table_factory: BlockBasedTable
2024/11/07-11:23:20.913625 7c58 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (000001CE191E1FF0)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
checksum: 4
no_block_cache: 0
block_cache: 000001CE16A1C840
block_cache_name: LRUCache
block_cache_options:
capacity : 8388608
num_shard_bits : 4
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.000
low_pri_pool_ratio: 0.000
persistent_cache: 0000000000000000
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2
2024/11/07-11:23:20.913628 7c58 Options.write_buffer_size: 67108864
2024/11/07-11:23:20.913630 7c58 Options.max_write_buffer_number: 2
2024/11/07-11:23:20.913633 7c58 Options.compression: Snappy
2024/11/07-11:23:20.913635 7c58 Options.bottommost_compression: Disabled
2024/11/07-11:23:20.913639 7c58 Options.prefix_extractor: nullptr
2024/11/07-11:23:20.913642 7c58 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2024/11/07-11:23:20.913644 7c58 Options.num_levels: 7
2024/11/07-11:23:20.913647 7c58 Options.min_write_buffer_number_to_merge: 1
2024/11/07-11:23:20.913649 7c58 Options.max_write_buffer_number_to_maintain: 0
2024/11/07-11:23:20.913652 7c58 Options.max_write_buffer_size_to_maintain: 134217728
2024/11/07-11:23:20.913654 7c58 Options.bottommost_compression_opts.window_bits: -14
2024/11/07-11:23:20.913657 7c58 Options.bottommost_compression_opts.level: 32767
2024/11/07-11:23:20.913659 7c58 Options.bottommost_compression_opts.strategy: 0
2024/11/07-11:23:20.913662 7c58 Options.bottommost_compression_opts.max_dict_bytes: 0
2024/11/07-11:23:20.913664 7c58 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2024/11/07-11:23:20.913667 7c58 Options.bottommost_compression_opts.parallel_threads: 1
2024/11/07-11:23:20.913670 7c58 Options.bottommost_compression_opts.enabled: false
2024/11/07-11:23:20.913672 7c58 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2024/11/07-11:23:20.913675 7c58 Options.bottommost_compression_opts.use_zstd_dict_trainer: true
2024/11/07-11:23:20.913677 7c58 Options.compression_opts.window_bits: -14
2024/11/07-11:23:20.913680 7c58 Options.compression_opts.level: 32767
2024/11/07-11:23:20.913682 7c58 Options.compression_opts.strategy: 0
2024/11/07-11:23:20.913685 7c58 Options.compression_opts.max_dict_bytes: 0
2024/11/07-11:23:20.913687 7c58 Options.compression_opts.zstd_max_train_bytes: 0
2024/11/07-11:23:20.913690 7c58 Options.compression_opts.use_zstd_dict_trainer: true
2024/11/07-11:23:20.913692 7c58 Options.compression_opts.parallel_threads: 1
2024/11/07-11:23:20.913695 7c58 Options.compression_opts.enabled: false
2024/11/07-11:23:20.913697 7c58 Options.compression_opts.max_dict_buffer_bytes: 0
2024/11/07-11:23:20.913700 7c58 Options.level0_file_num_compaction_trigger: 4
2024/11/07-11:23:20.913702 7c58 Options.level0_slowdown_writes_trigger: 20
2024/11/07-11:23:20.913705 7c58 Options.level0_stop_writes_trigger: 36
2024/11/07-11:23:20.913707 7c58 Options.target_file_size_base: 67108864
2024/11/07-11:23:20.913710 7c58 Options.target_file_size_multiplier: 1
2024/11/07-11:23:20.913712 7c58 Options.max_bytes_for_level_base: 268435456
2024/11/07-11:23:20.913715 7c58 Options.level_compaction_dynamic_level_bytes: 0
2024/11/07-11:23:20.913717 7c58 Options.max_bytes_for_level_multiplier: 10.000000
2024/11/07-11:23:20.913720 7c58 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2024/11/07-11:23:20.913723 7c58 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2024/11/07-11:23:20.913725 7c58 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2024/11/07-11:23:20.913728 7c58 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2024/11/07-11:23:20.913730 7c58 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2024/11/07-11:23:20.913733 7c58 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2024/11/07-11:23:20.913735 7c58 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2024/11/07-11:23:20.913738 7c58 Options.max_sequential_skip_in_iterations: 8
2024/11/07-11:23:20.913740 7c58 Options.max_compaction_bytes: 1677721600
2024/11/07-11:23:20.913743 7c58 Options.ignore_max_compaction_bytes_for_input: true
2024/11/07-11:23:20.913746 7c58 Options.arena_block_size: 1048576
2024/11/07-11:23:20.913748 7c58 Options.soft_pending_compaction_bytes_limit: 68719476736
2024/11/07-11:23:20.913751 7c58 Options.hard_pending_compaction_bytes_limit: 274877906944
2024/11/07-11:23:20.913753 7c58 Options.disable_auto_compactions: 0
2024/11/07-11:23:20.913756 7c58 Options.compaction_style: kCompactionStyleLevel
2024/11/07-11:23:20.913759 7c58 Options.compaction_pri: kMinOverlappingRatio
2024/11/07-11:23:20.913762 7c58 Options.compaction_options_universal.size_ratio: 1
2024/11/07-11:23:20.913765 7c58 Options.compaction_options_universal.min_merge_width: 2
2024/11/07-11:23:20.913767 7c58 Options.compaction_options_universal.max_merge_width: 4294967295
2024/11/07-11:23:20.913770 7c58 Options.compaction_options_universal.max_size_amplification_percent: 200
2024/11/07-11:23:20.913772 7c58 Options.compaction_options_universal.compression_size_percent: -1
2024/11/07-11:23:20.913775 7c58 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2024/11/07-11:23:20.913778 7c58 Options.compaction_options_fifo.max_table_files_size: 1073741824
2024/11/07-11:23:20.913780 7c58 Options.compaction_options_fifo.allow_compaction: 0
2024/11/07-11:23:20.913783 7c58 Options.table_properties_collectors:
2024/11/07-11:23:20.913786 7c58 Options.inplace_update_support: 0
2024/11/07-11:23:20.913788 7c58 Options.inplace_update_num_locks: 10000
2024/11/07-11:23:20.913791 7c58 Options.memtable_prefix_bloom_size_ratio: 0.000000
2024/11/07-11:23:20.913793 7c58 Options.memtable_whole_key_filtering: 0
2024/11/07-11:23:20.913796 7c58 Options.memtable_huge_page_size: 0
2024/11/07-11:23:20.913798 7c58 Options.bloom_locality: 0
2024/11/07-11:23:20.913801 7c58 Options.max_successive_merges: 0
2024/11/07-11:23:20.913803 7c58 Options.optimize_filters_for_hits: 0
2024/11/07-11:23:20.913806 7c58 Options.paranoid_file_checks: 0
2024/11/07-11:23:20.913808 7c58 Options.force_consistency_checks: 1
2024/11/07-11:23:20.913811 7c58 Options.report_bg_io_stats: 0
2024/11/07-11:23:20.913813 7c58 Options.ttl: 2592000
2024/11/07-11:23:20.913816 7c58 Options.periodic_compaction_seconds: 0
2024/11/07-11:23:20.913818 7c58 Options.preclude_last_level_data_seconds: 0
2024/11/07-11:23:20.913821 7c58 Options.preserve_internal_time_seconds: 0
2024/11/07-11:23:20.913823 7c58 Options.enable_blob_files: false
2024/11/07-11:23:20.913826 7c58 Options.min_blob_size: 0
2024/11/07-11:23:20.913829 7c58 Options.blob_file_size: 268435456
2024/11/07-11:23:20.913831 7c58 Options.blob_compression_type: NoCompression
2024/11/07-11:23:20.913834 7c58 Options.enable_blob_garbage_collection: false
2024/11/07-11:23:20.913836 7c58 Options.blob_garbage_collection_age_cutoff: 0.250000
2024/11/07-11:23:20.913839 7c58 Options.blob_garbage_collection_force_threshold: 1.000000
2024/11/07-11:23:20.913842 7c58 Options.blob_compaction_readahead_size: 0
2024/11/07-11:23:20.913844 7c58 Options.blob_file_starting_level: 0
2024/11/07-11:23:20.913847 7c58 Options.experimental_mempurge_threshold: 0.000000
2024/11/07-11:23:20.913884 7c58 [ing flush for any column family internally (non-manual flush) will trigger flushing all column families even if the number of memtables is smaller min_write_buffer_number_to_merge. Therefore, configuring min_write_buffer_number_to_merge > 1 is not compatible and should be satinized to 1. Not doing so will lead to data loss and inconsistent state across multiple column families when WAL is disabled, which is a common setting for atomic flush:621] --------------- Options for column family [meta/CustomFolderIndexer/P:]:
2024/11/07-11:23:20.913888 7c58 Options.comparator: leveldb.BytewiseComparator
2024/11/07-11:23:20.913890 7c58 Options.merge_operator: None
2024/11/07-11:23:20.913893 7c58 Options.compaction_filter: None
2024/11/07-11:23:20.913895 7c58 Options.compaction_filter_factory: None
2024/11/07-11:23:20.913898 7c58 Options.sst_partitioner_factory: None
2024/11/07-11:23:20.913900 7c58 Options.memtable_factory: SkipListFactory
2024/11/07-11:23:20.913903 7c58 Options.table_factory: BlockBasedTable
2024/11/07-11:23:20.913917 7c58 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (000001CE191E1AE0)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
checksum: 4
no_block_cache: 0
block_cache: 000001CE16A1C930
block_cache_name: LRUCache
block_cache_options:
capacity : 8388608
num_shard_bits : 4
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.000
low_pri_pool_ratio: 0.000
persistent_cache: 0000000000000000
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2
2024/11/07-11:23:20.913920 7c58 Options.write_buffer_size: 67108864
2024/11/07-11:23:20.913922 7c58 Options.max_write_buffer_number: 2
2024/11/07-11:23:20.913925 7c58 Options.compression: Snappy
2024/11/07-11:23:20.913927 7c58 Options.bottommost_compression: Disabled
2024/11/07-11:23:20.913930 7c58 Options.prefix_extractor: nullptr
2024/11/07-11:23:20.913932 7c58 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2024/11/07-11:23:20.913935 7c58 Options.num_levels: 7
2024/11/07-11:23:20.913937 7c58 Options.min_write_buffer_number_to_merge: 1
2024/11/07-11:23:20.913940 7c58 Options.max_write_buffer_number_to_maintain: 0
2024/11/07-11:23:20.913942 7c58 Options.max_write_buffer_size_to_maintain: 134217728
2024/11/07-11:23:20.913945 7c58 Options.bottommost_compression_opts.window_bits: -14
2024/11/07-11:23:20.913947 7c58 Options.bottommost_compression_opts.level: 32767
2024/11/07-11:23:20.913950 7c58 Options.bottommost_compression_opts.strategy: 0
2024/11/07-11:23:20.913953 7c58 Options.bottommost_compression_opts.max_dict_bytes: 0
2024/11/07-11:23:20.913955 7c58 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2024/11/07-11:23:20.913958 7c58 Options.bottommost_compression_opts.parallel_threads: 1
2024/11/07-11:23:20.913960 7c58 Options.bottommost_compression_opts.enabled: false
2024/11/07-11:23:20.913963 7c58 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2024/11/07-11:23:20.913966 7c58 Options.bottommost_compression_opts.use_zstd_dict_trainer: true
2024/11/07-11:23:20.913968 7c58 Options.compression_opts.window_bits: -14
2024/11/07-11:23:20.913971 7c58 Options.compression_opts.level: 32767
2024/11/07-11:23:20.913973 7c58 Options.compression_opts.strategy: 0
2024/11/07-11:23:20.913976 7c58 Options.compression_opts.max_dict_bytes: 0
2024/11/07-11:23:20.913978 7c58 Options.compression_opts.zstd_max_train_bytes: 0
2024/11/07-11:23:20.913981 7c58 Options.compression_opts.use_zstd_dict_trainer: true
2024/11/07-11:23:20.913983 7c58 Options.compression_opts.parallel_threads: 1
2024/11/07-11:23:20.913986 7c58 Options.compression_opts.enabled: false
2024/11/07-11:23:20.913988 7c58 Options.compression_opts.max_dict_buffer_bytes: 0
2024/11/07-11:23:20.913991 7c58 Options.level0_file_num_compaction_trigger: 4
2024/11/07-11:23:20.913993 7c58 Options.level0_slowdown_writes_trigger: 20
2024/11/07-11:23:20.913996 7c58 Options.level0_stop_writes_trigger: 36
2024/11/07-11:23:20.913998 7c58 Options.target_file_size_base: 67108864
2024/11/07-11:23:20.914002 7c58 Options.target_file_size_multiplier: 1
2024/11/07-11:23:20.914005 7c58 Options.max_bytes_for_level_base: 268435456
2024/11/07-11:23:20.914007 7c58 Options.level_compaction_dynamic_level_bytes: 0
2024/11/07-11:23:20.914010 7c58 Options.max_bytes_for_level_multiplier: 10.000000
2024/11/07-11:23:20.914012 7c58 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2024/11/07-11:23:20.914015 7c58 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2024/11/07-11:23:20.914018 7c58 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2024/11/07-11:23:20.914020 7c58 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2024/11/07-11:23:20.914023 7c58 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2024/11/07-11:23:20.914025 7c58 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2024/11/07-11:23:20.914028 7c58 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2024/11/07-11:23:20.914031 7c58 Options.max_sequential_skip_in_iterations: 8
2024/11/07-11:23:20.914033 7c58 Options.max_compaction_bytes: 1677721600
2024/11/07-11:23:20.914036 7c58 Options.ignore_max_compaction_bytes_for_input: true
2024/11/07-11:23:20.914038 7c58 Options.arena_block_size: 1048576
2024/11/07-11:23:20.914041 7c58 Options.soft_pending_compaction_bytes_limit: 68719476736
2024/11/07-11:23:20.914043 7c58 Options.hard_pending_compaction_bytes_limit: 274877906944
2024/11/07-11:23:20.914046 7c58 Options.disable_auto_compactions: 0
2024/11/07-11:23:20.914049 7c58 Options.compaction_style: kCompactionStyleLevel
2024/11/07-11:23:20.914051 7c58 Options.compaction_pri: kMinOverlappingRatio
2024/11/07-11:23:20.914054 7c58 Options.compaction_options_universal.size_ratio: 1
2024/11/07-11:23:20.914056 7c58 Options.compaction_options_universal.min_merge_width: 2
2024/11/07-11:23:20.914059 7c58 Options.compaction_options_universal.max_merge_width: 4294967295
2024/11/07-11:23:20.914061 7c58 Options.compaction_options_universal.max_size_amplification_percent: 200
2024/11/07-11:23:20.914064 7c58 Options.compaction_options_universal.compression_size_percent: -1
2024/11/07-11:23:20.914067 7c58 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2024/11/07-11:23:20.914069 7c58 Options.compaction_options_fifo.max_table_files_size: 1073741824
2024/11/07-11:23:20.914072 7c58 Options.compaction_options_fifo.allow_compaction: 0
2024/11/07-11:23:20.914075 7c58 Options.table_properties_collectors:
2024/11/07-11:23:20.914077 7c58 Options.inplace_update_support: 0
2024/11/07-11:23:20.914080 7c58 Options.inplace_update_num_locks: 10000
2024/11/07-11:23:20.914082 7c58 Options.memtable_prefix_bloom_size_ratio: 0.000000
2024/11/07-11:23:20.914085 7c58 Options.memtable_whole_key_filtering: 0
2024/11/07-11:23:20.914087 7c58 Options.memtable_huge_page_size: 0
2024/11/07-11:23:20.914090 7c58 Options.bloom_locality: 0
2024/11/07-11:23:20.914092 7c58 Options.max_successive_merges: 0
2024/11/07-11:23:20.914095 7c58 Options.optimize_filters_for_hits: 0
2024/11/07-11:23:20.914097 7c58 Options.paranoid_file_checks: 0
2024/11/07-11:23:20.914100 7c58 Options.force_consistency_checks: 1
2024/11/07-11:23:20.914103 7c58 Options.report_bg_io_stats: 0
2024/11/07-11:23:20.914105 7c58 Options.ttl: 2592000
2024/11/07-11:23:20.914108 7c58 Options.periodic_compaction_seconds: 0
2024/11/07-11:23:20.914110 7c58 Options.preclude_last_level_data_seconds: 0
2024/11/07-11:23:20.914113 7c58 Options.preserve_internal_time_seconds: 0
2024/11/07-11:23:20.914115 7c58 Options.enable_blob_files: false
2024/11/07-11:23:20.914118 7c58 Options.min_blob_size: 0
2024/11/07-11:23:20.914120 7c58 Options.blob_file_size: 268435456
2024/11/07-11:23:20.914124 7c58 Options.blob_compression_type: NoCompression
2024/11/07-11:23:20.914127 7c58 Options.enable_blob_garbage_collection: false
2024/11/07-11:23:20.914129 7c58 Options.blob_garbage_collection_age_cutoff: 0.250000
2024/11/07-11:23:20.914132 7c58 Options.blob_garbage_collection_force_threshold: 1.000000
2024/11/07-11:23:20.914135 7c58 Options.blob_compaction_readahead_size: 0
2024/11/07-11:23:20.914137 7c58 Options.blob_file_starting_level: 0
2024/11/07-11:23:20.914140 7c58 Options.experimental_mempurge_threshold: 0.000000
2024/11/07-11:23:20.918664 7c58 [to load table properties for file %llu — %s
:5713] Recovered from manifest file:C:\Users\tichy\AppData\Roaming\Listary\UserProfile\Cache\TICHY-JNT\Index/MANIFEST-012030 succeeded,manifest_file_number is 12030, next_file_number is 12032, last_sequence is 532611438, log_number is 12023,prev_log_number is 0,max_column_family is 984,min_log_number_to_keep is 12023
2024/11/07-11:23:20.918675 7c58 [to load table properties for file %llu — %s
:5722] Column family [default] (ID 0), log number is 12023
2024/11/07-11:23:20.918678 7c58 [to load table properties for file %llu — %s
:5722] Column family [db/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}] (ID 960), log number is 12023
2024/11/07-11:23:20.918681 7c58 [to load table properties for file %llu — %s
:5722] Column family [meta/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}] (ID 962), log number is 12023
2024/11/07-11:23:20.918684 7c58 [to load table properties for file %llu — %s
:5722] Column family [db/CustomFolderIndexer/P:] (ID 983), log number is 12023
2024/11/07-11:23:20.918687 7c58 [to load table properties for file %llu — %s
:5722] Column family [meta/CustomFolderIndexer/P:] (ID 984), log number is 12023
2024/11/07-11:23:20.918943 7c58 [upported:537] DB ID: 9d8cd718-56c8-11ee-ab8e-a029425c9e68
2024/11/07-11:23:20.939180 7c58 EVENT_LOG_v1 {“time_micros”: 1730975000939168, “job”: 1, “event”: “recovery_started”, “wal_files”: [12029]}
2024/11/07-11:23:20.939195 7c58 [upported:1031] Recovering log #12029 mode 2
2024/11/07-11:23:20.956834 7c58 EVENT_LOG_v1 {“time_micros”: 1730975000956806, “cf_name”: "db/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}", “job”: 1, “event”: “table_file_creation”, “file_number”: 12033, “file_size”: 60787, “file_checksum”: “”, “file_checksum_func_name”: “Unknown”, “smallest_seqno”: 532611441, “largest_seqno”: 532633011, “table_properties”: {“data_size”: 59442, “index_size”: 340, “index_partitions”: 0, “top_level_index_size”: 0, “index_key_is_user_key”: 1, “index_value_is_delta_encoded”: 1, “filter_size”: 0, “raw_key_size”: 20928, “raw_average_key_size”: 12, “raw_value_size”: 70028, “raw_average_value_size”: 40, “num_data_blocks”: 23, “num_entries”: 1744, “num_filter_entries”: 0, “num_deletions”: 46, “num_merge_operands”: 0, “num_range_deletions”: 0, “format_version”: 0, “fixed_key_len”: 0, “filter_policy”: “”, “column_family_name”: "db/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}", “column_family_id”: 960, “comparator”: “leveldb.BytewiseComparator”, “merge_operator”: “nullptr”, “prefix_extractor_name”: “nullptr”, “property_collectors”: “”, “compression”: “Snappy”, “compression_options”: "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", “creation_time”: 1730975000, “oldest_key_time”: 0, “file_creation_time”: 0, “slow_compression_estimated_data_size”: 0, “fast_compression_estimated_data_size”: 0, “db_id”: “9d8cd718-56c8-11ee-ab8e-a029425c9e68”, “db_session_id”: “YYM7N11YJM1IFX04FP26”, “orig_file_number”: 12033, “seqno_to_time_mapping”: “N/A”}}
2024/11/07-11:23:20.963392 7c58 EVENT_LOG_v1 {“time_micros”: 1730975000963366, “cf_name”: "meta/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}", “job”: 1, “event”: “table_file_creation”, “file_number”: 12034, “file_size”: 1088, “file_checksum”: “”, “file_checksum_func_name”: “Unknown”, “smallest_seqno”: 532612086, “largest_seqno”: 532633012, “table_properties”: {“data_size”: 66, “index_size”: 25, “index_partitions”: 0, “top_level_index_size”: 0, “index_key_is_user_key”: 1, “index_value_is_delta_encoded”: 1, “filter_size”: 0, “raw_key_size”: 35, “raw_average_key_size”: 17, “raw_value_size”: 12, “raw_average_value_size”: 6, “num_data_blocks”: 1, “num_entries”: 2, “num_filter_entries”: 0, “num_deletions”: 0, “num_merge_operands”: 0, “num_range_deletions”: 0, “format_version”: 0, “fixed_key_len”: 0, “filter_policy”: “”, “column_family_name”: "meta/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}", “column_family_id”: 962, “comparator”: “leveldb.BytewiseComparator”, “merge_operator”: “nullptr”, “prefix_extractor_name”: “nullptr”, “property_collectors”: “”, “compression”: “Snappy”, “compression_options”: "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", “creation_time”: 1730975000, “oldest_key_time”: 0, “file_creation_time”: 0, “slow_compression_estimated_data_size”: 0, “fast_compression_estimated_data_size”: 0, “db_id”: “9d8cd718-56c8-11ee-ab8e-a029425c9e68”, “db_session_id”: “YYM7N11YJM1IFX04FP26”, “orig_file_number”: 12034, “seqno_to_time_mapping”: “N/A”}}
2024/11/07-11:23:20.969207 7c58 EVENT_LOG_v1 {“time_micros”: 1730975000969182, “cf_name”: “meta/CustomFolderIndexer/P:”, “job”: 1, “event”: “table_file_creation”, “file_number”: 12035, “file_size”: 1072, “file_checksum”: “”, “file_checksum_func_name”: “Unknown”, “smallest_seqno”: 532632068, “largest_seqno”: 532632262, “table_properties”: {“data_size”: 96, “index_size”: 24, “index_partitions”: 0, “top_level_index_size”: 0, “index_key_is_user_key”: 1, “index_value_is_delta_encoded”: 1, “filter_size”: 0, “raw_key_size”: 58, “raw_average_key_size”: 19, “raw_value_size”: 16, “raw_average_value_size”: 5, “num_data_blocks”: 1, “num_entries”: 3, “num_filter_entries”: 0, “num_deletions”: 0, “num_merge_operands”: 0, “num_range_deletions”: 0, “format_version”: 0, “fixed_key_len”: 0, “filter_policy”: “”, “column_family_name”: “meta/CustomFolderIndexer/P:”, “column_family_id”: 984, “comparator”: “leveldb.BytewiseComparator”, “merge_operator”: “nullptr”, “prefix_extractor_name”: “nullptr”, “property_collectors”: “”, “compression”: “Snappy”, “compression_options”: "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", “creation_time”: 1730975000, “oldest_key_time”: 0, “file_creation_time”: 0, “slow_compression_estimated_data_size”: 0, “fast_compression_estimated_data_size”: 0, “db_id”: “9d8cd718-56c8-11ee-ab8e-a029425c9e68”, “db_session_id”: “YYM7N11YJM1IFX04FP26”, “orig_file_number”: 12035, “seqno_to_time_mapping”: “N/A”}}
2024/11/07-11:23:20.969795 7c58 EVENT_LOG_v1 {“time_micros”: 1730975000969791, “job”: 1, “event”: “recovery_finished”}
2024/11/07-11:23:20.970132 7c58 [to load table properties for file %llu — %s
:5180] Creating manifest 12037
2024/11/07-11:23:21.004142 7c58 [er_sec %lli, total_trash_size %llu max_trash_db_ratio %lf:77] Deleted file C:\Users\tichy\AppData\Roaming\Listary\UserProfile\Cache\TICHY-JNT\Index/012029.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2024/11/07-11:23:21.004211 7c58 [upported:1977] SstFileManager instance 000001CE18D615B0
2024/11/07-11:23:21.004369 9bec [ %s:1988] [db/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}] [JOB 3] Compacting 4@0 + 1@1 files to L1, score 1.00
2024/11/07-11:23:21.004385 9bec [ %s:1992] [db/NtfsVolumeIndexer/\?\Volume{eee834f2-11f5-4b14-984f-dafc9239a6b6}]: Compaction start summary: Base version 11 Base level 0, inputs: [12033(59KB) 12026(194KB) 12019(355KB) 12009(533KB)], [12005(46MB)]
2024/11/07-11:23:21.004404 9bec EVENT_LOG_v1 {“time_micros”: 1730975001004391, “job”: 3, “event”: “compaction_started”, “compaction_reason”: “LevelL0FilesNum”, “files_L0”: [12033, 12026, 12019, 12009], “files_L1”: [12005], “score”: 1, “input_data_size”: 49449751, “oldest_snapshot_seqno”: -1}
2024/11/07-11:23:21.013567 7c58 DB pointer 000001CE19057E40
2024/11/07-11:23:21.014174 a7d8 [failed due to Fatal/Unrecoverable error:1085] ------- DUMPING STATS -------
2024/11/07-11:23:21.014185 a7d8 [failed due to Fatal/Unrecoverable error:1086]