Label Already Exists

[kaybinwong]

errors occur after flin-1.14.3 restart

2023-03-08 19:17:37,474 INFO  org.apache.doris.flink.sink.writer.DorisStreamLoad           [] - load Result {
    "TxnId": -1,
    "Label": "doris_dev_user_1_23",
    "TwoPhaseCommit": "true",
    "Status": "Label Already Exists",
    "ExistingJobStatus": "FINISHED",
    "Message": "errCode = 2, detailMessage = Label [doris_dev_user_1_23] has already been used, relate to txn [50985]",
    "NumberTotalRows": 0,
    "NumberLoadedRows": 0,
    "NumberFilteredRows": 0,
    "NumberUnselectedRows": 0,
    "LoadBytes": 0,
    "LoadTimeMs": 0,
    "BeginTxnTimeMs": 0,
    "StreamLoadPutTimeMs": 0,
    "ReadDataTimeMs": 0,
    "WriteDataTimeMs": 0,
    "CommitAndPublishTimeMs": 0
}

2023-03-08 19:17:37,474 WARN  org.apache.doris.flink.sink.writer.DorisStreamLoad           [] - failed to stream load data
org.apache.doris.flink.exception.DorisException: Load status is Label Already Exists and load job finished, change you label prefix or restore from latest savepoint!
        at org.apache.doris.flink.sink.writer.DorisStreamLoad.abortPreCommit(DorisStreamLoad.java:154) ~[flink-doris-connector-1.14_2.12-1.1.1.jar:1.1.1]
        at org.apache.doris.flink.sink.writer.DorisWriter.initializeLoad(DorisWriter.java:112) ~[flink-doris-connector-1.14_2.12-1.1.1.jar:1.1.1]
        at org.apache.doris.flink.sink.DorisSink.createWriter(DorisSink.java:64) ~[flink-doris-connector-1.14_2.12-1.1.1.jar:1.1.1]
        at org.apache.flink.streaming.runtime.operators.sink.SinkOperator.initializeState(SinkOperator.java:145) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:119) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:109) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:711) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:687) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:654) ~[flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) [flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) [flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) [flink-dist_2.12-1.14.3.jar:1.14.3]
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) [flink-dist_2.12-1.14.3.jar:1.14.3]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_291]
2023-03-08 19:17:37,474 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader.

but actually, nothing in doris.

bug or something done wrong?

[yagagagaga]

show stream load

you should execute above command

[kaybinwong]

nothing with command show stream load, it is so stranger.

[gnehil]

If you need to query stream load records, you need to enable stream load records in BE first, by setting enable_stream_load_record=true in be.conf

[kaybinwong]

yeah, you're right, missing edit be.conf.