26 Commits

Author SHA1 Message Date
a8b365b051 fix(docker): keep pnpm workspace layout in the MX image
apps/smtp-server/node_modules contains symlinks into the root pnpm store;
copying only that directory left them dangling and the container crashed
with "Cannot find module 'smtp-server'".

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 02:12:30 +03:00
6f39776933 feat: Wave 3 C1/C2 — inbound MX server and received email API
Adds Resend "Receiving emails" parity:

**C1 — Inbound MX server (apps/smtp-server/src/inbound/)**
- Port-25 SMTP listener in `inbound/server.ts`; started when `INBOUND_ENABLED=true`
- `mailauth` (MIT) for SPF/DKIM/DMARC/ARC verification; drops DMARC-reject failures
- OCI Object Storage (raw .eml + attachments) with local-disk fallback via `INBOUND_STORAGE_DIR`
- Optional ClamAV scan via `CLAMD_HOST`; non-blocking (fail-open on timeout)
- Per-IP connection limit (`INBOUND_MAX_CONNECTIONS_PER_IP`)
- Recipient domain allowlist polled from web app every 5 minutes; rejects unknown domains (550)
- Internal HTTP relay via `api-client.ts` to `POST /api/internal/inbound`

**C2 — Received email API + dashboard**
- `webhook-events.ts`: adds `email.received` event with `ReceivedEmailPayload`
- `received-email-service.ts`: persist + query received emails; `email.received` webhook dispatch
- `inbound-storage-service.ts`: signed OCI PAR download URLs for attachments
- `domain-receiving.ts`: MX record helper; toggle receiving; injected into `buildDnsRecords`
- `POST /api/internal/inbound` + `GET /api/internal/inbound/domains` (shared-secret protected)
- Resend-compat routes: `GET /emails/received`, `/emails/received/:id`, `/emails/received/:id/attachments`, `/emails/received/:id/attachments/:aid`
- tRPC `receivedEmail` router (list, get, setReceiving) for dashboard
- Dashboard `/receiving` page with table + sandboxed HTML preview; no remote loads

**Deploy docs + compose**
- `docker/Dockerfile.mx`: slim MX service image
- `compose.scribase-mail.yml`: `mx` profile service on `0.0.0.0:25`; notes OCI firewall + DNS
- `DEPLOY.md`: Inbound MX section (DNS, OCI security list, grey-cloud record, start command)
- New env: `INBOUND_INTERNAL_SECRET`, `INBOUND_MX_HOSTNAME`

**Tests**
- `auth-check.unit.test.ts`: SPF/DKIM/DMARC result parsing (mailauth mocked)
- `storage.unit.test.ts`: local-disk fallback write/read
- `received-email-service.unit.test.ts`: persist, query, pagination, error paths (Prisma mocked)
- `received.api.test.ts`: GET list/detail/attachments against Hono in-process (db mocked)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 03:55:11 +03:00
e281ca03ac feat: abuse controls for the shared OCI tenancy
- Cloud mode on in deploy (IS_CLOUD build arg): sign-ups without an
  invite are waitlisted until the admin approves them; ADMIN_EMAIL required
- Warm-up daily caps by team age (50/200/1k/5k, plan limit after 30 days),
  skipped for admin-verified teams
- Reputation guard job (every 10 min, 7-day window): warn at 2% hard
  bounce / 0.05% complaint, pause at 4% / 0.1% (min 2 complaints);
  records blockedReason/blockedAt and notifies team + admin
- Admin: block reason shown and kept in sync, team cache invalidated,
  re-waitlisting an owner blocks their teams' sending
- System mail always relays through OCI when FROM_EMAIL is set (cloud
  mode previously fell through to the upstream useSend cloud client)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 03:04:45 +03:00
f0ceeaa2e0 feat: Scribase Mail branding, docs, deploy prep and AGPL notices
- rename product to Scribase Mail across web app, emails, marketing and docs
- new monochrome mark/favicons and neutral black/white theme; remove emoji UI
- source code link (AGPL-3.0) in sidebar, login and unsubscribe pages
- rewrite marketing site and self-hosting docs for OCI Email Delivery,
  add OCI notes page (event sources, unavailable features)
- add NOTICE and MERGE.md crediting useSend and listing changes
- add deploy/compose.scribase-mail.yml (web+postgres+redis, 1.47 GB limits),
  deploy/.env.example, Caddy site and DEPLOY.md for mail.scribase.com
- replace legacy provider env vars in turbo.json, CI, env examples, docker files
- OCI SDK packages as server externals for the standalone build

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 01:57:04 +03:00
David Vallejo
afb7e3717c
fix: docker host binding (#438)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
2026-08-30 07:09:01 +10:00
KM Koushik
86e3812ebe
fix: address Dependabot security alerts (#418)
* fix: address Dependabot security alerts

Entire-Checkpoint: ffd86f2fc074

* chore: upgrade pnpm to 11

* fix: address pnpm 11 review findings

* fix: preserve build-compatible dependency versions

* security: scope dependency build approvals

* Revert "security: scope dependency build approvals"

This reverts commit 6b751d468d8d58fdf725e306fc94bc2d23affe89.

* fix: add pnpm global bin to Docker path

Entire-Checkpoint: 396debe63edd
2026-07-12 08:01:14 +10:00
KM Koushik
04d0f4b123
feat: support standard AWS env vars and default credential chain (#401)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
* feat: support standard AWS env vars and default credential chain

Replace non-standard AWS_ACCESS_KEY / AWS_SECRET_KEY with the AWS-standard
AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY. The old names are kept as
fallbacks in the runtimeEnv for backward compatibility.

Both vars are now optional. When omitted, the credentials object is not
passed to SESv2Client, STSClient, or SNSClient — the AWS SDK then falls
back to its default provider chain (IAM roles, ECS task roles, instance
profiles, etc.), which is the recommended approach for cloud-native deployments.

Closes #316

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* refactor: extract shared getAwsCredentialOptions helper and add partial-config guard

- Move the credential spread logic into a single credentials.ts helper
  so SESv2Client, STSClient, and SNSClient all share one implementation
- Throw a clear error if only one of AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY
  is set, preventing silent fallback to the default provider chain with a
  half-configured environment

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix: align AWS env vars in docker and docs

* fix: use alias import for AWS credentials helper

---------

Co-authored-by: purva <purvahk08@gmail.com>
Co-authored-by: Purva Kandalgaonkar <136103488+purva-8@users.noreply.github.com>
2026-05-17 21:23:28 +10:00
Michał Ordon
62d7c44efc
feat: add REDIS_KEY_PREFIX env var for Redis ACL namespace isolation (#365)
* feat: add REDIS_KEY_PREFIX env var for Redis ACL namespace isolation

Adds optional REDIS_KEY_PREFIX env var that prefixes all Redis keys
(BullMQ queues via `prefix` option, cache/lock/rate-limit keys via
`redisKey()` helper). When unset, behavior is unchanged (BullMQ
defaults to "bull:", cache keys are unprefixed).

This enables self-hosters using Redis ACL multi-tenancy to restrict
useSend to its own key namespace (e.g. `~usesend:*`).

16 files changed across env schema, Redis module, 9 BullMQ queue/worker
files, and 5 direct Redis key operation sites.

* docs: add REDIS_KEY_PREFIX to self-host assets and fix docker run example

Add REDIS_KEY_PREFIX env var to docker/prod/compose.yml, .env.example,
.env.selfhost.example, and self-hosting docs. Fix missing trailing
backslashes in standalone docker run example.

* fix(redis): disable ioredis ready check and BullMQ version check

Redis ACL blocks INFO command (in @dangerous category). ioredis uses
INFO for ready check, BullMQ uses it for version detection. Without
these flags, BullMQ workers fail to initialize and silently stop
processing jobs.

- Add enableReadyCheck: false to ioredis connection
- Add skipVersionCheck: true to all 5 Queue + 5 Worker constructors

* fix(redis): add skipVersionCheck to remaining BullMQ job queues

Add skipVersionCheck: true to Queue and Worker constructors in all 4 job
files (campaign-scheduler, cleanup-email-bodies, usage-job,
webhook-cleanup) to match the pattern already used in service files.
This prevents BullMQ version mismatch errors when using REDIS_KEY_PREFIX
with Redis ACL namespace isolation.
2026-03-02 08:12:47 +11:00
KM Koushik
487902421b
feat: add web testing foundation with infra-backed suites (#349)
* feat: add web test framework with infra-backed suites

* fix: honor DATABASE_URL env in integration prepare script

* fix: apply web test review feedback

* fix: streamline web test infra lifecycle and workflow scope
2026-02-16 09:13:29 +11:00
KM Koushik
8676965019
feat: add webhooks (#334) 2026-01-18 20:50:54 +11:00
KM Koushik
bba9e937bb
fix seg fault (#329)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
2025-12-30 07:45:34 +11:00
KM Koushik
7fdb82a9e9
Fix version display in side navigation (#306)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
Co-authored-by: Claude <noreply@anthropic.com>
2025-12-08 09:19:37 +11:00
KM Koushik
3e3f6d521a
Display Docker image version in sidebar (#304)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
Co-authored-by: Claude <noreply@anthropic.com>
2025-12-07 22:18:56 +11:00
KM Koushik
05a02844b2
Update prisma version in start script
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
2025-11-21 20:14:05 +11:00
KM Koushik
b2e0233758
fix: update docker node version (#290)
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:usesend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
2025-11-20 18:08:07 +11:00
Alen Abraham
987c07db35
fixed docker setup for psql (#248) 2025-09-21 08:09:11 +10:00
KM Koushik
07c53d3f58
rebrand to useSend (#210) 2025-09-03 08:21:55 +10:00
KMKoushik
3dcd8a1bcc fix docker build
Some checks failed
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:unsend], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:. dockerfile:./docker/Dockerfile name:unsend], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (map[context:./apps/smtp-server dockerfile:./apps/smtp-server/Dockerfile name:smtp-proxy], warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
2025-05-12 07:15:40 +10:00
KMKoushik
d107d59dfd change smtp env to server env 2025-03-31 23:18:01 +11:00
Sidharth Babu
5cf5022aed
refactor: dynamic SMTP for self host (#138)
Co-authored-by: KM Koushik <koushikmohan1996@gmail.com>
2025-03-29 14:40:25 +11:00
KM Koushik
0fc27d8d7e
auto unsubscribe on bounce and compaints (#117)
Some checks failed
Publish Docker / Build and publish platform containers (warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
* auto unsubscribe on bounce and compaints

* console
2025-03-18 00:25:11 +11:00
KM Koushik
0a1d93ac60
make dev setup better (#116)
Some checks failed
Publish Docker / Build and publish platform containers (warp-ubuntu-latest-arm64-2x) (push) Has been cancelled
Publish Docker / Build and publish platform containers (warp-ubuntu-latest-x64-2x) (push) Has been cancelled
Publish Docker / Create and publish manifest (push) Has been cancelled
* make dev setup better

* chage docs

* remove the need of github login
2025-03-17 21:33:43 +11:00
KM Koushik
f9105971f0
upload image option (#64) 2024-08-26 20:46:38 +10:00
KM Koushik
6af2521ebb
Add self hosting docs (#34)
* Add self host docs

* Add more documentation
2024-06-28 20:10:18 +10:00
KMKoushik
b23c025747 Fix github org name in packages 2024-06-25 08:53:45 +10:00
KM Koushik
f77a8829be
Improve Self host setup (#30)
* Add self host setup

* Improve blunders

* Move to bull mq

* More changes

* Add example code for sending test emails
2024-06-24 08:21:37 +10:00