feat: bundle mesh as a binary (ardatan#7339)

* fix * fix * fix * chore(dependencies): updated changesets for modified dependencies * fix * fix * fix * chore(dependencies): updated changesets for modified dependencies * ignore parcel in bundle * refactor bundling * chore(dependencies): updated changesets for modified dependencies * isomorphic graphql * no bundle-binary * package binary ci * e2e test bin * package bin only when bin * better packaage-binary script * build instructions * lowercase platform * no for * dedupe * chore(dependencies): updated changesets for modified dependencies * no test binary * no more package sh * win for windows * artifact names and path switch * put back inject-version * win build to dest * build for bin e2e * no win shortcut * npm i g tsx zx * improve uws injection * use sea-config instead of writing * chore(dependencies): updated changesets for modified dependencies * default version and clarify bin name * install sea packed deps * hooks for resolution of packed deps * chore(dependencies): updated changesets for modified dependencies * from* * zero dep * uws in packed modules * micro fixes * use default export of uWS for consistency * chore(dependencies): updated changesets for modified dependencies * bundle node-libcurl * .. * Skip zx * optional args * no zx * Fix comment * chore(dependencies): updated changesets for modified dependencies * Better comments for Images * Remove verbose logs for Docker build * Try Windows * Setup NASM for Windows * Fix * Do not throw * Fix * Faster build for Windows * Fix broken packaging * Fix releases * Fix build for Windows * Windows is win32 not windows * Fix Windows build * It is optional on Windows * Export correct artifacts for Windows * It has to be 22 unfortunately * Go * No more build needed * node-libcurl is first class citizen * chore(dependencies): updated changesets for modified dependencies * Fix lockfile * Hmm * chore(dependencies): updated changesets for modified dependencies * Simplify workflows * This is shell bas * Fix docker runner e2e * Fix e2e * Enable Docker for Mac * Go * Try again * Fix Windows build * Start Docker on macOS * Start using colima * Skip symlinking if fails * Fix Docker for MacOS * Remove rover * Fix signtool path * Fix Windows * Try again * Chill Windows * version + docs + install.sj * Windows? * Signtool * See err * More verbose error * New signtool location * Better error handling * More error * Fix Windows * Fix Windows again??? * Better abort error * Timeout for Serve CLI too * Try again * Fix URLs * Setup Docker and WSL * Go * macOS * Remove unnecessary timeouts * Go * Go * Peki * Try * Try again? * Try ?? * Try sth else * Faster Docker setup * Again? * Try again * Hello?? * Hellooo * Try sth * Try sth * Try sth * Hello * Go * More * Try again * Use Official action * Winget again?? * .. * Install Ubuntu * Try * Try another windows * Winget * Try simpler * Try again? * Try again? * Try this * Try * Try * Test * Hmm * Windows * Try this * Go * Test again * Go * Go * Again? * ... * Try 127.0.0.1 * Test 2 * Test * Sign using digicert * Last try * Let's goo * go * lets go * Go * Lets go * Try this * Test * Fix wsl integration * Try sth else * Yes * mayybeee * Fix uWS and node-libcurl imports on Windows * .. * Fix * Force exit on e2e tests * No need to import it * Correct defaults * Bump node-libcurl * Bump node-libcurl and align whatwg-node * chore(dependencies): updated changesets for modified dependencies * Fix Docker * .. * Go * Try this * Go * Fix * Fix windows things * Increase timeout * Go * Leave Windows work * Be more patient * Use whatwg-node * Fix Windows docker * Fix Windows path * Continue * Ok * Remove extra timeout * Trim printed errors * Trim printed errors in E2E tests * Trim in exit code error as well * Test boot2docker on Windows * wtf * curl ftw * .. * Try * Go * Go * ?? * port * Try again * Try this * Try localhost * This is the only way * Run qemu * Go * Make sure it is running * Try again * Go * Choco * Put it in the background * Wait port * wait * Of * Try better `resource` * Try * Leave note and logoff * .. * Trim in the thrown error too * Maybe works on Windows? * Try this * Hmm... * FFF * .. * .. * Fix again * Fix.. * Release * Try again * Better docker build action * Avoid extra work * Hive Gateway binaryu * Install.sh for hive-gateway * Disable uWS in Windows to try * Less work for Windows * Windows * Add jaeger windows * Try again * .. * Fix * Windows 2019 * Disable windows e2e for now * Smaller package for soap * More * .. --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: enisdenjo <[email protected]> Co-authored-by: Arda TANRIKULU <[email protected]>
BouyguesTelecom · Sep 2, 2024 · b50ad41 · b50ad41
1 parent 379c9cf
commit b50ad41
Show file tree

Hide file tree

Showing 85 changed files with 2,389 additions and 867 deletions.
diff --git a/.changeset/@graphql-mesh_cli-7339-dependencies.md b/.changeset/@graphql-mesh_cli-7339-dependencies.md
@@ -0,0 +1,5 @@
+---
+"@graphql-mesh/cli": patch
+---
+dependencies updates:
+  - Added dependency [`node-libcurl@npm:@ardatan/node-libcurl@^4.0.2` ↗︎](https://www.npmjs.com/package/node-libcurl/v/4.0.2) (to `dependencies`)
diff --git a/.changeset/@graphql-mesh_serve-cli-7339-dependencies.md b/.changeset/@graphql-mesh_serve-cli-7339-dependencies.md
@@ -0,0 +1,5 @@
+---
+"@graphql-mesh/serve-cli": patch
+---
+dependencies updates:
+  - Added dependency [`node-libcurl@npm:@ardatan/node-libcurl@^4.0.2` ↗︎](https://www.npmjs.com/package/node-libcurl/v/4.0.2) (to `dependencies`)
diff --git a/.github/workflows/loadtest.yml b/.github/workflows/loadtest.yml
@@ -7,8 +7,8 @@ on:
       - master
 
 jobs:
-  e2e:
-    name: e2e / node ${{matrix.node-version}}
+  loadtest-e2e:
+    name: node ${{matrix.node-version}}
     runs-on: ubuntu-latest
     strategy:
       fail-fast: false
@@ -20,8 +20,6 @@ jobs:
     steps:
       - name: checkout
         uses: actions/checkout@v4
-      - name: Install Required Libraries
-        run: sudo apt update && sudo apt install -y libcurl4-openssl-dev libssl-dev
       - uses: the-guild-org/shared-config/setup@v1
         name: setup env
         with:

diff --git a/.github/workflows/pr.yml b/.github/workflows/pr.yml
@@ -30,31 +30,32 @@ jobs:
     runs-on: ubuntu-latest
     needs: [release]
     strategy:
+      fail-fast: false
       matrix:
-        include:
-          - productname: mesh-serve
-            packagename: '@graphql-mesh/serve-cli'
-          - productname: hive-gateway
-            packagename: '@graphql-hive/gateway'
+        productname: [mesh-serve, hive-gateway]
     if: contains(needs.release.outputs.publishedPackages, '@graphql-mesh/serve-cli')
     steps:
+      - name: Choose names
+        id: names
+        run: |
+          echo "::set-output name=productname::${{ matrix.productname == 'mesh-serve' && 'mesh-serve' || 'hive-gateway' }}"
+          echo "::set-output name=packagename::${{ matrix.productname == 'mesh-serve' && '@graphql-mesh/serve-cli' || '@graphql-hive/gateway' }}"
+          echo "::set-output name=packagedir::${{ matrix.productname == 'mesh-serve' && 'packages/serve-cli' || 'packages/hive-gateway' }}"
       - name: version ${{ matrix.productname }}
         uses: actions/github-script@v7
         id: ver-mesh-serve
         with:
           result-encoding: string
           script: |
             const publishedPackages = ${{ needs.release.outputs.publishedPackages }};
-            const meshServe = publishedPackages.find((p) => p.name === '${{ matrix.packagename }}');
+            const meshServe = publishedPackages.find((p) => p.name === '${{ steps.names.outputs.packagename }}');
             if (!meshServe) {
-              return core.setFailed('${{ matrix.packagename }} was not published!');
+              return core.setFailed('${{ steps.names.outputs.packagename }} was not published!');
             }
             console.log(meshServe.version);
             return meshServe.version;
       - name: checkout
         uses: actions/checkout@v4
-      - name: Install Required Libraries
-        run: sudo apt update && sudo apt install -y libcurl4-openssl-dev libssl-dev
       - name: set up docker buildx
         uses: docker/setup-buildx-action@v3
       - name: log in to ghcr
@@ -70,10 +71,10 @@ jobs:
       - name: prepare
         run: yarn prebuild
       - name: bundle
-        run: yarn bundle
+        run: yarn workspace ${{steps.names.outputs.packagename }} bundle
       - name: inject ${{ matrix.productname }} version
         run: |
-          yarn workspace ${{ matrix.packagename }} inject-version ${{ steps.ver-mesh-serve.outputs.result }}
+          yarn workspace ${{steps.names.outputs.packagename }} inject-version ${{ steps.ver-mesh-serve.outputs.result }}
       - name: bake and push
         uses: docker/bake-action@v5
         env:
@@ -87,9 +88,70 @@ jobs:
       - name: comment on pr
         uses: marocchino/sticky-pull-request-comment@v2
         with:
-          header: Docker Image for ${{ matrix.productname }}
+          header: Docker Image for `${{ matrix.productname }}`
           message: |
-            Published images for this PR are available at:
+            Published `${{matrix.productname}}` images for this PR are available at:
             ```
             ghcr.io/ardatan/${{ matrix.productname }}:${{ steps.ver-mesh-serve.outputs.result }}
             ```
+
+  bin:
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        os: [ubuntu-latest, macos-latest, macos-latest-large, windows-latest]
+        productname: [mesh-serve, hive-gateway]
+    steps:
+      - name: Choose names
+        id: names
+        run: |
+          echo "::set-output name=productname::${{ matrix.productname == 'mesh-serve' && 'mesh-serve' || 'hive-gateway' }}"
+          echo "::set-output name=packagename::${{ matrix.productname == 'mesh-serve' && '@graphql-mesh/serve-cli' || '@graphql-hive/gateway' }}"
+          echo "::set-output name=packagedir::${{ matrix.productname == 'mesh-serve' && 'packages/serve-cli' || 'packages/hive-gateway' }}"
+      - name: checkout
+        uses: actions/checkout@v2
+
+      # Install Windows specific dependencies
+      - if: runner.os == 'Windows'
+        name: Disable Windows Defender
+        run: Set-MpPreference -DisableRealtimeMonitoring $true
+        shell: powershell
+      - if: runner.os == 'Windows'
+        name: Install Windows SDK
+        uses: fbactions/setup-winsdk@v2
+        with:
+          winsdk-build-version: 18362
+
+      - uses: the-guild-org/shared-config/setup@v1
+        name: set up env
+        with:
+          node-version-file: .node-version
+      - name: prepare
+        run: yarn prebuild
+      - name: bundle
+        run: yarn workspace ${{steps.names.outputs.packagename }} bundle
+      - name: inject ${{ steps.names.outputs.packagename }} version
+        run: |
+          yarn workspace ${{steps.names.outputs.packagename }} inject-version ${{ github.sha }}
+      - name: package binary
+        run: yarn workspace ${{steps.names.outputs.packagename }} package-binary
+      - name: upload artifact
+        id: upload_artifact
+        uses: actions/upload-artifact@v4
+        with:
+          name:
+            ${{ matrix.productname}}-${{runner.os}}-${{runner.arch}}${{ runner.os == 'Windows' &&
+            '.exe' || ''}}
+          path: |
+            ${{ steps.names.outputs.packagedir }}/${{ matrix.productname }}${{ runner.os == 'Windows' && '.exe' || '' }}
+      - name: update PR comment with artifact link
+        uses: marocchino/sticky-pull-request-comment@v2
+        with:
+          header: 'Node Sea Artifacts Status (`${{ runner.os }}-${{ runner.arch }}`)'
+          message: |
+            The build artifacts of `${{ matrix.productname }}` as a single executable for `${{ runner.os }}-${{ runner.arch }}` are available at:
+            [Download](https://github.com/${{ github.repository }}/actions/runs/${{ github.run_id }}/artifacts/${{ steps.upload_artifact.outputs.artifact-id }})
+
+        env:
+          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
diff --git a/.github/workflows/release.yml b/.github/workflows/release.yml
@@ -25,24 +25,27 @@ jobs:
   ghcr:
     runs-on: ubuntu-latest
     strategy:
+      fail-fast: false
       matrix:
-        include:
-          - productname: mesh-serve
-            packagename: '@graphql-mesh/serve-cli'
-          - productname: hive-gateway
-            packagename: '@graphql-hive/gateway'
+        productname: [mesh-serve, hive-gateway]
     needs: [stable]
     if: contains(needs.stable.outputs.publishedPackages, '@graphql-mesh/serve-cli')
     steps:
+      - name: Choose names
+        id: names
+        run: |
+          echo "::set-output name=productname::${{ matrix.productname == 'mesh-serve' && 'mesh-serve' || 'hive-gateway' }}"
+          echo "::set-output name=packagename::${{ matrix.productname == 'mesh-serve' && '@graphql-mesh/serve-cli' || '@graphql-hive/gateway' }}"
+          echo "::set-output name=packagedir::${{ matrix.productname == 'mesh-serve' && 'packages/serve-cli' || 'packages/hive-gateway' }}"
       - name: version ${{ matrix.productname }}
         uses: actions/github-script@v7
         id: ver-mesh-serve
         with:
           script: |
             const publishedPackages = ${{ needs.stable.outputs.publishedPackages }};
-            const meshServe = publishedPackages.find((p) => p.name === '${{ matrix.packagename }}');
+            const meshServe = publishedPackages.find((p) => p.name === '${{ steps.names.outputs.packagename }}');
             if (!meshServe) {
-              return core.setFailed('${{ matrix.packagename }} was not published!');
+              return core.setFailed('${{ steps.names.outputs.packagename }} was not published!');
             }
             const { version } = meshServe;
             const [major, minor] = version.split('.');
@@ -54,8 +57,6 @@ jobs:
             return r;
       - name: checkout
         uses: actions/checkout@v4
-      - name: Install Required Libraries
-        run: sudo apt update && sudo apt install -y libcurl4-openssl-dev libssl-dev
       - name: set up docker buildx
         uses: docker/setup-buildx-action@v3
       - name: log in to ghcr
@@ -71,10 +72,10 @@ jobs:
       - name: prepare
         run: yarn prebuild
       - name: bundle
-        run: yarn bundle
+        run: yarn workspace ${{ steps.names.outputs.packagename }} bundle
       - name: inject ${{ matrix.productname }} version
         run: |
-          yarn workspace ${{ matrix.packagename }} inject-version ${{ fromJSON(steps.ver-mesh-serve.outputs.result).version }}
+          yarn workspace ${{ steps.names.outputs.packagename }} inject-version ${{ fromJSON(steps.ver-mesh-serve.outputs.result).version }}
       - name: bake and push
         uses: docker/bake-action@v5
         env:
@@ -85,3 +86,78 @@ jobs:
             *.cache-from=type=gha
             *.cache-to=type=gha,mode=max
           push: true
+
+  bin:
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        os: [ubuntu-latest, macos-latest, macos-latest-large, windows-latest]
+        productname: [mesh-serve, hive-gateway]
+    needs: [stable]
+    if: contains(needs.stable.outputs.publishedPackages, '@graphql-mesh/serve-cli')
+    steps:
+      - name: Choose names
+        id: names
+        run: |
+          echo "::set-output name=productname::${{ matrix.productname == 'mesh-serve' && 'mesh-serve' || 'hive-gateway' }}"
+          echo "::set-output name=packagename::${{ matrix.productname == 'mesh-serve' && '@graphql-mesh/serve-cli' || '@graphql-hive/gateway' }}"
+          echo "::set-output name=packagedir::${{ matrix.productname == 'mesh-serve' && 'packages/serve-cli' || 'packages/hive-gateway' }}"
+      - name: version ${{ matrix.productname }}
+        uses: actions/github-script@v7
+        id: ver-mesh-serve
+        with:
+          script: |
+            const publishedPackages = ${{ needs.stable.outputs.publishedPackages }};
+            const meshServe = publishedPackages.find((p) => p.name === '${{ steps.names.outputs.packagename }}');
+            if (!meshServe) {
+              return core.setFailed('${{ steps.names.outputs.packagename }} was not published!');
+            }
+            const { version } = meshServe;
+            const [major, minor] = version.split('.');
+            if (!major || !minor) {
+              return core.setFailed(`Unknown major or minor in version "${version}"!`);
+            }
+            const r = { version, tags: `latest,${major},${major}.${minor},${version}` };
+            console.log(r);
+            return r;
+      - name: checkout
+        uses: actions/checkout@v2
+
+      # Install Windows specific dependencies
+      - if: runner.os == 'Windows'
+        name: Disable Windows Defender
+        run: Set-MpPreference -DisableRealtimeMonitoring $true
+        shell: powershell
+      - if: matrix.os == 'windows-latest'
+        name: Install Windows SDK
+        uses: fbactions/setup-winsdk@v2
+        with:
+          winsdk-build-version: 18362
+
+      - uses: the-guild-org/shared-config/setup@v1
+        name: set up env
+        with:
+          node-version-file: .node-version
+      - name: prepare
+        run: yarn prebuild
+      - name: bundle
+        run: yarn workspace ${{ steps.names.outputs.packagename }} bundle
+      - name: inject ${{ matrix.productname }} version
+        run: |
+          yarn workspace ${{steps.names.outputs.packagename }} inject-version ${{ steps.ver-mesh-serve.outputs.result }}
+      - name: package binary
+        run: yarn workspace ${{ steps.names.outputs.packagename }} package-binary
+        shell: bash
+      - name: Upload binaries to release
+        uses: svenstaro/upload-release-action@v2
+        with:
+          repo_token: ${{ secrets.GITHUB_TOKEN }}
+          file:
+            ${{ steps.names.outputs.packagedir }}/${{ matrix.productname }}${{ runner.os ==
+            'Windows' && '.exe' || ''}}
+          asset_name:
+            ${{ matrix.productname }}-${{ runner.os }}-${{ runner.arch }}${{ runner.os == 'Windows'
+            && '.exe' || ''}}
+          tag: ${{fromJSON(steps.ver-mesh-serve.outputs.result).version}}
+          overwrite: true