Elassandra 单节点集群未启动。陷入突变阶段

Question

我在盒子上有一个单节点 Elassandra 集群运行。夜幕降临。以下是最后一行 systemctl 状态输出：

Main process exited, code=killed, status=6/ABRT

然而，在重新启动后，它陷入了突变阶段，类似的行反复出现在日志中（/var/log/cassandra/system.log）：

2020-09-14 12:53:38,048 TRACE [MutationStage-31] ElasticSecondaryIndex.java:2158 readCellValue indexer=730313363 name=value kind=REGULAR type=text value={"dw1":{"6":{"total_weight":"72664168.50","total_count":"5979710.00","product_name":"Masala 12g","target_weight":"12","mean_weight":"12.15","th_packed_weight":"71756520.00","ega":"907648.50","ega_per":"1.26"}},"dw2":{"6":{"total_weight":"72654813.00","total_count":"5979710.00","product_name":"Masala 12g","target_weight":"12","mean_weight":"12.15","th_packed_weight":"71756520.00","ega":"898293.00","ega_per":"1.25"}}}

tpstats 输出：

Pool Name                         Active   Pending      Completed   Blocked  All time blocked
ReadStage                              0         0              0         0                 0
MiscStage                              0         0              0         0                 0
CompactionExecutor                     0         0              9         0                 0
MutationStage                         32       920        5808076         0                 0
MemtableReclaimMemory                  0         0              8         0                 0
GossipStage                            0         0              0         0                 0
SecondaryIndexManagement               0         0              0         0                 0
RequestResponseStage                   0         0              0         0                 0
ReadRepairStage                        0         0              0         0                 0
CounterMutationStage                   0         0              0         0                 0
MigrationStage                         0         0              0         0                 0
MemtablePostFlush                      0         0              8         0                 0
PerDiskMemtableFlushWriter_0           0         0              8         0                 0
ValidationExecutor                     0         0              0         0                 0
Sampler                                0         0              0         0                 0
MemtableFlushWriter                    0         0              8         0                 0
InternalResponseStage                  0         0              0         0                 0
ViewMutationStage                      0         0              0         0                 0
AntiEntropyStage                       0         0              0         0                 0
CacheCleanupExecutor                   0         0              0         0                 0

Message type           Dropped
READ                         0
RANGE_SLICE                  0
_TRACE                       0
HINT                         0
MUTATION                     0
COUNTER_MUTATION             0
BATCH_STORE                  0
BATCH_REMOVE                 0
REQUEST_RESPONSE             0
PAGED_RANGE                  0
READ_REPAIR                  0

MutationStage 下的待定计数永远不会变为零。长期处于这种状态。此集群中没有其他节点，目前没有数据写入。

Answer 1

对我来说，您描述的症状表明突变正在从 commitlog 重播。

您可以通过以下方式解决此问题：

暂时关闭 C*。
将 commitlog/ 的内容移动到另一个目录。
启动 Cassandra。

Elassandra 单节点集群未启动。陷入突变阶段

Elassandra single node cluster not starting. Stuck in Mutation Stage

cassandra

elasticsearch

elassandra