Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(runtime): detach custom dependency, support node_module caching #1658

Merged
merged 15 commits into from
Nov 27, 2023
Merged

feat(runtime): detach custom dependency, support node_module caching #1658

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
ac3c70e
feat: add custom dep path
skyoct Nov 19, 2023
93af4fe
fix: fix path
skyoct Nov 19, 2023
a0c47d3
fix: remove console
skyoct Nov 20, 2023
78e7b36
chore: remove log4js from runtime, allow adding dup npm deps
maslow Nov 23, 2023
6e37103
chore: rm unused imports
maslow Nov 23, 2023
d23bacc
fix(runtime): support custom dep path in import()
maslow Nov 23, 2023
1bb7520
Merge remote-tracking branch 'upstream/main' into feat/dep
maslow Nov 23, 2023
68be7e6
chore: merge upstream main
maslow Nov 23, 2023
7aa4d4c
fix(runtime): add --experimental-vm-modules for runtime
maslow Nov 23, 2023
f237f3a
feat(runtime): support node_modules cache in init scripts
maslow Nov 27, 2023
eb11eeb
fix(runtime): fix download error in init script
maslow Nov 27, 2023
c23fe93
debug node modules cache pull script
maslow Nov 27, 2023
c72897f
debug node modules cache pull script
maslow Nov 27, 2023
8c47f6b
debug node modules cache pull script
maslow Nov 27, 2023
153f387
feat(server): support node_modules cache in server
maslow Nov 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
feat(runtime): support node_modules cache in init scripts
  • Loading branch information
@maslow
maslow committed Nov 27, 2023
commit f237f3a73635084780f49cad4c470c37d7d20aa7
81 changes: 78 additions & 3 deletions runtimes/nodejs/init.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,17 +1,92 @@
#!/bin/sh

set -e
# node ./dist/init.js

# npm init
echo "npm init -y"
npm init -y
# echo "npm init -y"
# npm init -y

# skip init if $DEPENDENCIES is empty
if [ -z "$DEPENDENCIES" ]; then
echo "No dependencies to install."
exit 0
fi

# if $NODE_MODULES_URL is not empty
if [ -n "$NODE_MODULES_PULL_URL" ]; then
echo "Downloading node_modules from $NODE_MODULES_PULL_URL"

# get start time
start_time=$(date +%s)

# temporarily disable set -e
set +e

# download node_modules.tar and untar to `node_modules`
curl -sSfL $NODE_MODULES_PULL_URL | tar -xf - -C .

# re-enable set -e
set -e

# if error
if [ $? -ne 0 ]; then
echo "Failed to download node_modules cache."
else
end_time=$(date +%s)
elapsed_time=$(expr $end_time - $start_time)
echo "Downloaded and extracted node_modules in $elapsed_time seconds."
fi
fi

CACHED_DEPENDENCIES=""
# if node_modules/.dependencies exists
if [ -f "node_modules/.dependencies" ]; then
$CACHED_DEPENDENCIES=`cat node_modules/.dependencies`
fi

# if $CACHED_DEPENDENCIES is not empty and $CACHED_DEPENDENCIES is equal to $DEPENDENCIES
if [ -n "$CACHED_DEPENDENCIES" ] && [ "$CACHED_DEPENDENCIES" = "$DEPENDENCIES" ]; then
echo "No dependencies changed since last cache build."
exit 0
fi


# npm install $DEPENDENCIES
start_time=$(date +%s)
echo "npm install $DEPENDENCIES $NPM_INSTALL_FLAGS"
npm install $DEPENDENCIES $NPM_INSTALL_FLAGS
end_time=$(date +%s)
elapsed_time=$(expr $end_time - $start_time)
echo "Installed dependencies in $elapsed_time seconds."

# if $NODE_MODULES_PUSH_URL is not empty
if [ -n "$NODE_MODULES_PUSH_URL" ]; then
# temporarily disable set -e
set +e

start_time=$(date +%s)
echo $DEPENDENCIES > node_modules/.dependencies
echo "Uploading node_modules to $NODE_MODULES_PUSH_URL"

# tar `node_modules` to node_modules.tar
tar -cf node_modules.tar ./node_modules

end_time_1=$(date +%s)
elapsed_time=$(expr $end_time_1 - $start_time)
echo "Compressed node_modules in $elapsed_time seconds."

# upload node_modules.tar to $NODE_MODULES_PUSH_URL
curl -sSfL -X PUT -T node_modules.tar $NODE_MODULES_PUSH_URL

# re-enable set -e
set -e

if [ $? -ne 0 ]; then
echo "Failed to upload node_modules cache."
else
end_time_2=$(date +%s)
elapsed_time_2=$(expr $end_time_2 - $end_time)
echo "Uploaded node_modules.tar in $elapsed_time_2 seconds."
echo "Uploaded node_modules cache."
fi
fi