Webstorm ide validate yaml8/18/2023 To solve it, go to Run -> Edit Configuration -> Modify options -> Use classpath of module and in the new field, mark Include dependencies with "Provided" scope.Įxception in thread "main" : No operators defined in streaming topology. This is a particular problem of Flink running in the IDE: some dependencies are missing. An error like this should appear in the output:Įxception in thread "main" : org/apache/flink/streaming/api/environment/StreamExecutionEnvironment at (StreamingJob.java:39) Caused by: . at (URLClassLoader.java:382) at (ClassLoader.java:418) at $AppClassLoader.loadClass(Launcher.java:352) at (ClassLoader.java:351). You can go to StreamingJob.java and execute it as a normal Java application using the Shift F10 shortcut on Linux/Windows. You can do it easily from the command-line. First of all, import in the IDE as a maven project. We are going only to cover my favourite Java IDE: IntelliJ IDEA. We are going to focus only on StreamingJob.java. The structure of the project is quite simple. DarchetypeArtifactId=flink-quickstart-java \ To bootstrap the project, just execute the following Maven command: mvn archetype:generate \ We aren't going to need it initially so it's better to stop it: $FLINK_HOME/bin/stop-cluster.sh You can access the Flink Web Dashboard in your browser. Start the cluster: $FLINK_HOME/bin/start-cluster.sh Note: it's a good idea to create a variable $FLINK_HOME pointing to the Flink folder. This is straightforward, just go to the Flink download page and download it: wget ![]() The source code is available in this GitHub repository. If you are already an experienced Flink developer, there are some tricks you may find useful: access to JMX metrics, profiling, etc. If Flink is something new for you, it's an easy guide to follow. In this article, I summarize some of the notes I've been writing since I started with Flink. Even if there is a good Getting Started or a great (and free) Hands-on Training, there are always questions about how to start, how to debug problems or how to launch the project in your IDE. As any of those framework, start to work with it can be a challenge. Flink setup for development (and some IntelliJ Idea cool tricks)Īpache Flink is an open-source, unified stream-processing and batch-processing framework.
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |