Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Hive] While Hive as Source,Doris as Sink In Flink Engine,all result data sink in the first cloumn in Doris #8426

Open
2 of 3 tasks
guojp00 opened this issue Jan 2, 2025 · 0 comments
Labels

Comments

@guojp00
Copy link

guojp00 commented Jan 2, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

While Hive as Source,Doris as Sink,all result sink in the first cloumn in Doris

SeaTunnel Version

2.3.5

SeaTunnel Config

env {
  parallelism = 1
  job.mode = "BATCH"
}

source {
  Hive {
    table_name = "seatunnel_test_source.sys_menu_test_source"
    metastore_uri = "thrift://xxxxxxx"
    result_table_name = "sys_menu_test_source_source"
     #read_columns = [id,uuid,code,name,create_date,update_date,remarks,del_flag]
  }
}
transform {

}
sink {
  Doris {
    fenodes = "xxxxx"
    username = "xxxx"
    password = "xxxx"
    table.identifier = "seatunnal_test_target.sys_menu_test_target"
    database = "seatunnal_test_target"
    table = "sys_menu_test_target"
    sink.label-prefix = "test"
    "source_table_name"="sys_menu_test_target_target"
    field.delimiter = ","
    doris.config {
       format = "json"
       read_json_by_line = "true"
    }
  }
}

Running Command

normal command

Error Exception

emty

Zeta or Flink or Spark Version

Flink 2.3.5

Java or Scala Version

1.8

Screenshots

image

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@guojp00 guojp00 added the bug label Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant