Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What are the advantages of siddhi over flink-cep #27

Open
shidayang opened this issue Jan 14, 2019 · 7 comments
Open

What are the advantages of siddhi over flink-cep #27

shidayang opened this issue Jan 14, 2019 · 7 comments
Assignees

Comments

@shidayang
Copy link

I don't konw how to chose siddhi and flink-cep

@haoch
Copy link
Owner

haoch commented Jan 15, 2019

Some advantages:

  • flink siddhi have richer CEP features than flink-cep.
  • flink siddhi support flexible SQL language than flink-cep only supports Java DSL.
  • flink siddhi support dynamic cep runtime (modify ad-hoc without restart)

@haoch haoch self-assigned this Jan 15, 2019
@haoch
Copy link
Owner

haoch commented Jan 15, 2019

@shidayang What's your use case?

@panenming
Copy link

panenming commented Jan 17, 2019

dou you have example for (flink siddhi support dynamic cep runtime (modify ad-hoc without restart)) and can one stream apply to more than one dynamic ceps?

@haoch
Copy link
Owner

haoch commented Jan 18, 2019

@panenming please have a look about https://github.com/haoch/flink-siddhi/blob/master/core/src/test/java/org/apache/flink/streaming/siddhi/SiddhiCEPITCase.java#L441 basically idea is
image

you could send control event (Add/Deleted/Update) through ControlStream which physically could connect to some Kafka topic or other source and just send the control operation you want and it will apply to the DAG cep runtime dynamically.

Please refer to https://github.com/haoch/flink-siddhi/blob/master/experimental/src/main/scala/com/github/haoch/experimental/CEPPipeline.scala as a complete example

@haoch haoch pinned this issue Jan 18, 2019
@shidayang
Copy link
Author

@haoch thanks,I also have a question. can siddhi resolve unsort event?

@haoch
Copy link
Owner

haoch commented Jan 18, 2019

@shidayang it doesn't have the concept of watermark in flink for out of order event, but it supports to keep some safe window for resorting events then process.

@GithubZhitao
Copy link

GithubZhitao commented Jul 27, 2022

Hi @haoch. Although I haven't know all about siddhi, I am really absorbed by it.
I have two questions:

  1. "flink siddhi support dynamic cep runtime" : Did you mean that one FLINK Job can run multi cep patterns distributed ?
  2. siddhi also has its own distribution plugin(https://github.com/siddhi-io/distribution). After I read the architecture document, I didn't find any description about the "exactly-once" or "watermark " or "event time, process time, session time" concepts. Can I say that FLINK did more than siddhi-distribution did?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants