[ST-Engine] Use SeatunnelChildFirstClassLoader to loader connector plugin #2479
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
fix style tmp tmp add e2e test
hailin0
reviewed
Aug 21, 2022
|
|
||
| transform { | ||
| # If you would like to get more information about how to configure seatunnel and see full list of transform plugins, | ||
| # please go to https://seatunnel.apache.org/docs/flink/configuration/transform-plugins/Sql |
There was a problem hiding this comment.
Use https://seatunnel.apache.org/docs/transform/sql ?
| } | ||
|
|
||
| # If you would like to get more information about how to configure seatunnel and see full list of sink plugins, | ||
| # please go to https://seatunnel.apache.org/docs/flink/configuration/sink-plugins/Console |
There was a problem hiding this comment.
Use https://seatunnel.apache.org/docs/connector-v2/sink/LocalFile ?
| } | ||
|
|
||
| # If you would like to get more information about how to configure seatunnel and see full list of sink plugins, | ||
| # please go to https://seatunnel.apache.org/docs/flink/configuration/sink-plugins/Console |
| @@ -65,7 +65,7 @@ public SeaTunnelServer(@NonNull Node node, @NonNull SeaTunnelConfig seaTunnelCon | |||
| this.liveOperationRegistry = new LiveOperationRegistry(); | |||
| this.seaTunnelConfig = seaTunnelConfig; | |||
| this.executorService = | |||
| Executors.newFixedThreadPool(seaTunnelConfig.getEngineConfig().getServerExecutorPoolSize()); | |||
| Executors.newCachedThreadPool(); | |||
There was a problem hiding this comment.
Define thread name?
explame:
Executors.newCachedThreadPool(new ThreadFactoryBuilder()
.setNameFormat("seatunnel-server-executor-%d").build());| @@ -40,7 +40,7 @@ public Address applyForResource(long jobId, long taskId) { | |||
| Map<Long, Address> jobAddressMap = physicalVertexIdAndResourceMap.computeIfAbsent(jobId, k -> new HashMap<>()); | |||
|
|
|||
| Address localhost = | |||
| jobAddressMap.putIfAbsent(taskId, new Address("localhost", 5701)); | |||
| jobAddressMap.putIfAbsent(taskId, new Address("192.168.1.10", 5801)); | |||
| //import java.util.concurrent.atomic.AtomicBoolean; | ||
| //import java.util.function.BiConsumer; | ||
| // | ||
| //public class TaskExecutionServiceTest { |
EricJoy2048
changed the title
EricJoy2048
changed the title
hailin0
reviewed
Aug 24, 2022
| # This is a example source plugin **only for test and demonstrate the feature source plugin** | ||
| FakeSource { | ||
| result_table_name = "fake" | ||
| field_name = "name,age", |
There was a problem hiding this comment.
Use new config style? #2406
example:
FakeSource {
result_table_name = "fake"
fields {
name = string
age = int
}
}| env { | ||
| # You can set flink configuration here | ||
| execution.parallelism = 1 | ||
| job.mode = "STREAMING" |
Comment on lines
+31
to
+41
| FakeSource { | ||
| result_table_name = "fake" | ||
| field_name = "name,age", | ||
| parallelism = 3 | ||
| } | ||
|
|
||
| FakeSource { | ||
| result_table_name = "fake" | ||
| field_name = "name,age", | ||
| parallelism = 3 | ||
| } |
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
1、Finish a main process, submit-scheduler-finish.
2、Add engine e2e.