Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Add S3 source/sink connector #4082

Closed
2 tasks done
TheR1sing3un opened this issue Jun 7, 2023 · 2 comments · Fixed by #4132
Closed
2 tasks done

[Feature] Add S3 source/sink connector #4082

TheR1sing3un opened this issue Jun 7, 2023 · 2 comments · Fixed by #4132
Assignees
@TheR1sing3un
Labels
feature

Comments

@TheR1sing3un
Copy link
Member

Search before asking

  • I had searched in the issues and found no similar issues.

Feature Request

Implment the source/sink connector for S3 to pull data in S3File and write date to anothor S3File in an configurable format

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@github-actions
Copy link
Contributor

github-actions bot commented Jun 7, 2023

Welcome to the Apache EventMesh community!!
We are glad that you are contributing by opening this issue. :D

Please make sure to include all the relevant context.
We will be here shortly.

If you are interested in contributing to our project, please let us know!
You can check out our contributing guide on contributing to EventMesh.

Want to get closer to the community?

WeChat Assistant WeChat Public Account Slack
Join Slack Chat

Mailing Lists:

Name Description Subscribe Unsubscribe Archive
Users User support and questions mailing list Subscribe Unsubscribe Mail Archives
Development Development related discussions Subscribe Unsubscribe Mail Archives
Commits All commits to repositories Subscribe Unsubscribe Mail Archives
Issues Issues or PRs comments and reviews Subscribe Unsubscribe Mail Archives
@TheR1sing3un
Copy link
Member Author

@xwm1992 I will try to implement it, could u assign it to me?
@xwm1992 xwm1992 mentioned this issue May 29, 2023
Closed
2 tasks
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 17, 2023
@TheR1sing3un
feat(connector): add S3 file source connector with specified format
b4acd1b 
1. add S3 file source connector with specified format

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 17, 2023
@TheR1sing3un
test(connector): add S3SourceConnectorTest to verify
c81df9f 
1. add S3SourceConnectorTest to verify

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 17, 2023
@TheR1sing3un
feat(connector): add S3SourceWorker
ace8372 
1. add S3SourceWorker

Closes apache#4082
@TheR1sing3un TheR1sing3un mentioned this issue Jun 17, 2023
Merged
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 17, 2023
@TheR1sing3un
style(connector): add header license
59db8a6 
1. add header license

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 25, 2023
@TheR1sing3un
feat(connector): add S3 file source connector with specified format
e0ad16b 
1. add S3 file source connector with specified format

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 25, 2023
@TheR1sing3un
test(connector): add S3SourceConnectorTest to verify
ac6fb84 
1. add S3SourceConnectorTest to verify

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 25, 2023
@TheR1sing3un
feat(connector): add S3SourceWorker
45c1b3f 
1. add S3SourceWorker

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Jun 25, 2023
@TheR1sing3un
style(connector): add header license
388b6d5 
1. add header license

Closes apache#4082
@qqeasonchen qqeasonchen mentioned this issue Jul 24, 2023
Open
25 tasks
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 8, 2023
@TheR1sing3un
feat(connector): add S3 file source connector with specified format
3e0eb77 
1. add S3 file source connector with specified format

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 8, 2023
@TheR1sing3un
test(connector): add S3SourceConnectorTest to verify
b71389f 
1. add S3SourceConnectorTest to verify

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 8, 2023
@TheR1sing3un
feat(connector): add S3SourceWorker
04fb84c 
1. add S3SourceWorker

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 8, 2023
@TheR1sing3un
style(connector): add header license
a196bc6 
1. add header license

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 14, 2023
@TheR1sing3un
feat(connector): add S3 file source connector with specified format
0dc5c05 
1. add S3 file source connector with specified format

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 14, 2023
@TheR1sing3un
test(connector): add S3SourceConnectorTest to verify
80d260c 
1. add S3SourceConnectorTest to verify

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 14, 2023
@TheR1sing3un
feat(connector): add S3SourceWorker
7b1668b 
1. add S3SourceWorker

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 14, 2023
@TheR1sing3un
style(connector): add header license
532c8ec 
1. add header license

Closes apache#4082
TheR1sing3un added a commit to TheR1sing3un/eventmesh that referenced this issue Aug 14, 2023
@TheR1sing3un
refactor(connector): refactor S3 source connector
8fb302e 
1. refactor S3 source connector

Closes apache#4082
xwm1992 pushed a commit that referenced this issue Aug 15, 2023
@TheR1sing3un
[ISSUE #4082][Task1] Support S3 file source connector (#4132)
c29ada6 
* feat(connector): add S3 file source connector with specified format

1. add S3 file source connector with specified format

Closes #4082

* test(connector): add S3SourceConnectorTest to verify

1. add S3SourceConnectorTest to verify

Closes #4082

* feat(connector): add S3SourceWorker

1. add S3SourceWorker

Closes #4082

* style(connector): add header license

1. add header license

Closes #4082

* refactor(connector): refactor S3 source connector

1. refactor S3 source connector

Closes #4082
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature
1 participant
@TheR1sing3un