Convert worker to ESM (#500)
* Convert worker to ESM
To use ESM for the worker, I created a package.json file in worker/ with `{ type: "module" }` as its sole content.
I then rewrote every import to use ESM syntax.
I also tried to set `{ type: "module" }` in the root package.json file to also use ESM in next.config.js.
However, this resulted in a weird problem: default imports were now getting imported as objects in this shape: `{ default: <defaultImport> }`.
Afaik, this should only be the case if you use "import * as foo from 'bar'" syntax: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Statements/import#default_import
This is fixed by not using `{ type: "module" }` for some reason. However, then, next.config.js also doesn't support ESM import syntax anymore.
The documentation says that if you want to use ESM, you can use next.config.mjs: https://nextjs.org/docs/pages/api-reference/next-config-js
But I didn't want to use MJS extension since I don't have any experience with it. For example, not sure if it's good style to mix JS with MJS etc. So I kept the CJS import syntax there.
* Ignore worker/ during linting
I wasn't able to fix the following errors:
/home/runner/work/stacker.news/stacker.news/worker/auction.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/auction.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/earn.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/earn.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/index.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/index.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/nostr.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/nostr.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/ots.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/ots.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/repin.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/repin.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/search.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/search.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/streak.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/streak.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/trust.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/trust.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/views.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/views.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
/home/runner/work/stacker.news/stacker.news/worker/wallet.js:0:0: Parsing error: No Babel config file detected for /home/runner/work/stacker.news/stacker.news/worker/wallet.js. Either disable config file checking with requireConfigFile: false, or configure Babel so that it can find the config files. (null)
I tried to tell babel where to find the babel config file (.babelrc), specifying the babel config in worker/package.json under "babel", using babel.config.json etc. to no avail.
However, afaict, we don't need babel for the worker since it won't run in a browser. Babel is only used to transpile code to target browsers.
But it still would be nice to lint the worker code with standard.
But we can figure this out later.
* Fix worker imports from lib/ and api/
This fixes the issue that we can't use `{ "type": "module" }` in the root package.json since it breaks the app with this error:
app | TypeError: next_auth_providers_credentials__WEBPACK_IMPORTED_MODULE_2__ is not a function
app | at eval (webpack-internal:///./pages/api/auth/[...nextauth].js:218:20)
app | at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
app | LND GRPC connection successful
app | - error pages/api/auth/[...nextauth].js (139:2) @ CredentialsProvider
app | - error Error [TypeError]: next_auth_providers_credentials__WEBPACK_IMPORTED_MODULE_2__ is not a function
app | at eval (webpack-internal:///./pages/api/auth/[...nextauth].js:218:20) {
app | digest: undefined
app | }
app | 137 |
app | 138 | const providers = [
app | > 139 | CredentialsProvider({
app | | ^
app | 140 | id: 'lightning',
app | 141 | name: 'Lightning',
app | 142 | credentials: {
app | TypeError: next_auth_providers_credentials__WEBPACK_IMPORTED_MODULE_2__ is not a function
app | at eval (webpack-internal:///./pages/api/auth/[...nextauth].js:218:20)
app | at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
build but we need to tell the worker that the files are MJS, else we get this error:
worker | file:///app/worker/wallet.js:3
worker | import { datePivot } from '../lib/time.js'
worker | ^^^^^^^^^
worker | SyntaxError: Named export 'datePivot' not found. The requested module '../lib/time.js' is a CommonJS module, which may not support all module.exports as named exports.
worker | CommonJS modules can always be imported via the default export, for example using:
worker |
worker | import pkg from '../lib/time.js';
worker | const { datePivot } = pkg;
worker |
worker | at ModuleJob._instantiate (node:internal/modules/esm/module_job:124:21)
worker | at async ModuleJob.run (node:internal/modules/esm/module_job:190:5)
worker |
worker | Node.js v18.17.0
worker |
worker exited with code 1
* Fix global not defined in browser context
* Also ignore api/ and lib/ during linting
I did not want to do this but I was not able to fix this error in any other way I tried:
/home/ekzyis/programming/stacker.news/api/lnd/index.js:0:0: Parsing error: No Babel config file detected for /home/ekzyis/programming/stacker.news/api/lnd/index.js. Either disable config file checking with requ
ireConfigFile: false, or configure Babel so that it can find the config files. (null)
Did not want to look deeper into all this standard, eslint, babel configuration stuff ...
---------
Co-authored-by: ekzyis <ek@stacker.news>
Co-authored-by: Keyan <34140557+huumn@users.noreply.github.com>
2023-09-24 01:19:35 +00:00
|
|
|
import PgBoss from 'pg-boss'
|
|
|
|
import nextEnv from '@next/env'
|
|
|
|
import { PrismaClient } from '@prisma/client'
|
|
|
|
import { checkInvoice, checkWithdrawal } from './wallet.js'
|
|
|
|
import { repin } from './repin.js'
|
|
|
|
import { trust } from './trust.js'
|
|
|
|
import { auction } from './auction.js'
|
|
|
|
import { earn } from './earn.js'
|
|
|
|
import apolloClient from '@apollo/client'
|
|
|
|
import { indexItem, indexAllItems } from './search.js'
|
|
|
|
import { timestampItem } from './ots.js'
|
|
|
|
import { computeStreaks, checkStreak } from './streak.js'
|
|
|
|
import { nip57 } from './nostr.js'
|
|
|
|
import fetch from 'cross-fetch'
|
|
|
|
import { authenticatedLndGrpc } from 'ln-service'
|
|
|
|
import { views, rankViews } from './views.js'
|
|
|
|
|
|
|
|
const { loadEnvConfig } = nextEnv
|
|
|
|
const { ApolloClient, HttpLink, InMemoryCache } = apolloClient
|
|
|
|
|
|
|
|
loadEnvConfig('..')
|
2023-02-14 22:58:12 +00:00
|
|
|
|
2022-01-05 20:37:34 +00:00
|
|
|
async function work () {
|
2022-01-17 17:41:17 +00:00
|
|
|
const boss = new PgBoss(process.env.DATABASE_URL)
|
|
|
|
const models = new PrismaClient()
|
2022-01-25 19:34:51 +00:00
|
|
|
const apollo = new ApolloClient({
|
|
|
|
link: new HttpLink({
|
|
|
|
uri: `${process.env.SELF_URL}/api/graphql`,
|
|
|
|
fetch
|
|
|
|
}),
|
|
|
|
cache: new InMemoryCache(),
|
|
|
|
defaultOptions: {
|
|
|
|
watchQuery: {
|
2022-11-24 19:22:58 +00:00
|
|
|
fetchPolicy: 'no-cache',
|
|
|
|
nextFetchPolicy: 'no-cache'
|
2022-01-25 19:34:51 +00:00
|
|
|
},
|
|
|
|
query: {
|
2022-11-24 19:22:58 +00:00
|
|
|
fetchPolicy: 'no-cache',
|
|
|
|
nextFetchPolicy: 'no-cache'
|
2022-01-25 19:34:51 +00:00
|
|
|
}
|
|
|
|
}
|
|
|
|
})
|
|
|
|
|
2023-02-14 22:58:12 +00:00
|
|
|
const { lnd } = authenticatedLndGrpc({
|
|
|
|
cert: process.env.LND_CERT,
|
|
|
|
macaroon: process.env.LND_MACAROON,
|
|
|
|
socket: process.env.LND_SOCKET
|
|
|
|
})
|
|
|
|
|
|
|
|
const args = { boss, models, apollo, lnd }
|
2022-01-14 17:28:05 +00:00
|
|
|
|
2022-01-17 17:41:17 +00:00
|
|
|
boss.on('error', error => console.error(error))
|
2022-01-07 16:32:31 +00:00
|
|
|
|
2022-01-17 17:41:17 +00:00
|
|
|
await boss.start()
|
|
|
|
await boss.work('checkInvoice', checkInvoice(args))
|
|
|
|
await boss.work('checkWithdrawal', checkWithdrawal(args))
|
|
|
|
await boss.work('repin-*', repin(args))
|
|
|
|
await boss.work('trust', trust(args))
|
2023-01-22 20:17:50 +00:00
|
|
|
await boss.work('timestampItem', timestampItem(args))
|
2022-01-25 19:34:51 +00:00
|
|
|
await boss.work('indexItem', indexItem(args))
|
|
|
|
await boss.work('indexAllItems', indexAllItems(args))
|
2022-02-25 17:34:09 +00:00
|
|
|
await boss.work('auction', auction(args))
|
2022-03-17 20:13:19 +00:00
|
|
|
await boss.work('earn', earn(args))
|
2023-02-01 14:44:35 +00:00
|
|
|
await boss.work('streak', computeStreaks(args))
|
2023-02-02 19:47:09 +00:00
|
|
|
await boss.work('checkStreak', checkStreak(args))
|
2023-02-14 22:58:12 +00:00
|
|
|
await boss.work('nip57', nip57(args))
|
2023-05-18 23:41:56 +00:00
|
|
|
await boss.work('views', views(args))
|
2023-05-23 14:21:04 +00:00
|
|
|
await boss.work('rankViews', rankViews(args))
|
2022-01-05 20:37:34 +00:00
|
|
|
|
2022-01-17 17:41:17 +00:00
|
|
|
console.log('working jobs')
|
2022-01-05 20:37:34 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
work()
|