Skip to content

[CELEBORN-2379] Keep sbt and maven dependency lists in sync and cross-check both in CI#3757

Open
cxzl25 wants to merge 2 commits into
apache:mainfrom
cxzl25:CELEBORN-2379
Open

[CELEBORN-2379] Keep sbt and maven dependency lists in sync and cross-check both in CI#3757
cxzl25 wants to merge 2 commits into
apache:mainfrom
cxzl25:CELEBORN-2379

Conversation

@cxzl25

@cxzl25 cxzl25 commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR resolve a correctness bug?

  • Yes

Does this PR introduce any user-facing change?

  • Yes

How was this patch tested?

GHA

@cxzl25 cxzl25 marked this pull request as draft July 10, 2026 10:57
Comment thread dev/dependencies.sh

# Explicitly set locale in order to make `sort` output consistent across machines.
# See https://stackoverflow.com/questions/28881 for more details.
export LC_ALL=C

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The way this global environment variable is written may cause some character exceptions to be displayed during Java compilation.

Main

CelebornFlinkShim.java:23:38:  ??: ????Tuple2
[WARNING] javac exited with exit code 1

PR

CelebornFlinkShim.java:23:38:  错误: 无法访问Tuple2
[WARNING] javac exited with exit code 1

// no-op there. Gate it to JDK 8 to match the `JDKTools` plugin
// (project/JDKTools.scala) and the Maven `jdk-8` profile, and to keep the
// sbt/maven classpaths in sync (see dev/dependencies.sh).
libraryDependencies ++=

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If Flink2.3 uses sbt, it will bring additional maven-jdk-tools-wrapper dependency, which is wrong. This issue is fixed here.

./dev/dependencies.sh ${{ matrix.tool == 'sbt' && '--sbt' || '' }} --module ${{ matrix.module }} --check

maven-jdk11:
jdk11:

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

jdk11 jdk17 does not use sbt check, so some dependencies fail in sbt, here use matrix to reduce some duplication.

@cxzl25 cxzl25 marked this pull request as ready for review July 10, 2026 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant