Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion PLATFORM_STATUS.md
Original file line number Diff line number Diff line change
Expand Up @@ -806,7 +806,7 @@ done
| **L7** | Device Gateway | `5.13.0` | ✅ Operational |
| **L8** | Energy Manager | `2.1.0` | ✅ Operational |
| **L9** | Commerce Engine | `5.1.0` | ✅ Operational |
| **L10**| Token Engine | `4.3.8` | ✅ Operational |
| **L10**| Token Engine | `4.4.0` | ✅ Operational |
| **L11**| ML Engine | `0.5.0` | ✅ Operational |

---
Expand Down
35 changes: 35 additions & 0 deletions services/10-token-engine/WEEKLY_REPORT_SEPTEMBER_2026.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# L10 Weekly Report: Token Engine v4.4.0 (September 2026)

## 1. L10 Web3 & Rewards Report
Within the MiGrid ecosystem (Platform standard **v10.1.6**, September 2026), the Token Engine operates on version **v4.4.0** as the secure, high-performance Web3 bridge issuing ERC-20 utility tokens ($GRID) on the Polygon network. This weekly run focuses on cross-layer architectural alignment, multi-key payload normalization, and Zero-Trust JWT authentication parity across the stack.

### Cross-Layer Impact Analysis:
* **L1 Physics Engine (v10.1.6) & Telemetry Parity**: L1's high-fidelity telemetry scoring (separating raw floats from formatted 4-decimal strings) maps directly to L10’s telemetry standards. Standardizing both physics and confidence scores to strict 4-decimal strings (`safeFloat`) is critical for "Proof of Physics equals Proof of Value", preventing decimal rounding drift before rewards are logged and published to the L11 ML Engine training set. To align with L1's site extraction hardening, L10 v4.4.0's `extractSiteId` now searches nested `metadata` objects (`payload.metadata`), preventing site attribution loss during multi-level event processing.
* **L2 Grid Signal (v2.5.6) & L7 Device Gateway (v5.13.0) Alarms**: L7's normalized OCPP 2.1 `NotifyDERAlarm` events and L2's grid lock translator broadcast hardware alarm events across Kafka using various regional key structures (`iso_region`, `isoRegion`, `iso`, `region`). L10 v4.4.0's `DER_ALARM_REPORTED` Kafka consumer has been updated to normalize all regional key formats, ensuring that active regional alarms correctly increment Redis alarm counters (`l4:regional:alarms:<ISO>`) for dynamic hardware health penalties (-0.05 per active alarm, capped at -0.30).
* **L5 Driver API (v4.1.0) & L6 Engagement Engine (v5.18.0) Security Sync**: To maintain strict Zero-Trust defense across all service entrypoints, L10 v4.4.0 has expanded its token authentication middleware to explicitly block insecure development secrets (`development_secret` and `change_in_production`) under production environments (`process.env.NODE_ENV === 'production'`) with a 500 configuration error.
* **L9 Commerce Engine (v5.1.0) Security Parity**: L9 has hardened multi-tenant fleet isolation by joining charging sessions with vehicle records to verify session ownership by `fleet_id`. In parallel, L10 secures global data training streams (`GET /data/training/rewards`) by rejecting non-administrative/tenant tokens (tokens containing a `fleet_id`), enforcing mTLS and Zero-Trust standards.

### Smart Contract Lifecycle & Operational Strategy:
* **Open-Wallet Framework Integration**: Seamlessly abstracts private key signatures from end-users, delivering a fast, frictionless Web2 user experience. Gas fees, nonces, and transaction finality on the Polygon network are managed silently via a backend custodial architecture.
* **Secure Private Key Infrastructure**: Preparing the transition from custodial key signatures to a secure Hardware Security Module (HSM) and AWS Key Management Service (KMS) infrastructure to guarantee zero-vulnerability Web3 transaction signing.
* **Edge-Case Resilience (Outage Mitigation)**: To combat potential Polygon RPC node outages or dropped transactions, L10 leverages an asynchronous, gas-optimized batch minting worker. Queued rewards are processed using atomic state transitions (`FOR UPDATE SKIP LOCKED`) to protect against double-spending and guarantee that transient RPC issues do not lead to lost driver rewards.

---

## 2. Backlog Updates
* **P0: Nested Metadata Site Extraction [L10-P6]** — Implemented metadata fallback in `extractSiteId` for complete site ID parity across L1/L2/L10. (Complete)
* **P1: KMS/HSM Private Key Infrastructure [L10-P4]** — Integration of secure transaction-signing infrastructure for production deployments. (Active)
* **P2: ERC-20 Proxy Staking Contract Upgrade [L10-P7]** — Designing a proxy upgrade strategy to introduce non-custodial staking mechanics for drivers. (Planned)
* **P3: Multi-Format DER Alarm Region Normalization [L10-P8]** — Unified regional key extraction across `iso_region`, `isoRegion`, `iso`, and `region`. (Complete)
* **P4: Zero-Trust Token Auth Hardening [L10-SEC-02]** — Expanded weak secret rejection list (`development_secret`, `change_in_production`) for production environments. (Complete)

---

## 3. Engineering Execution (v4.4.0)
This week, we executed critical multi-key extraction hardening and security updates:
* **Version Upgrade**: Upgraded L10 microservice version from `4.3.9` to `4.4.0` inside `package.json`, `/health` check endpoint, and `/data/training/rewards` AI export standard (`source: 'L10_TOKEN_ENGINE_V4.4.0'`).
* **Site ID & Alarm Extraction Hardening**: Refactored `extractSiteId(payload)` in `services/10-token-engine/index.js` to inspect `payload.metadata` as a fallback. Normalized ISO region parsing in `DER_ALARM_REPORTED` Kafka consumer to handle `iso_region`, `isoRegion`, `iso`, and `region` keys.
* **Security Hardening**: Hardened `authenticateToken` middleware in `services/10-token-engine/index.js` to explicitly block `development_secret` and `change_in_production` from being utilized in production environments, returning a 500 error.
* **Unit Tests & Verification**: Updated `services/10-token-engine/tests/security_hardening.test.js` with active assertions for the newly blocked weak secrets, and built `verify_l10_v4_4_0.js` to validate health check status, duplicate function protection, AI export standards, and security hardening.

**Status**: Operational • **Version**: v4.4.0 • **Platform Standard**: v10.1.6
10 changes: 5 additions & 5 deletions services/10-token-engine/index.js
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ const authenticateToken = (req, res, next) => {

// Reject insecure or default keys in production
if (process.env.NODE_ENV === 'production' &&
(activeSecret === 'test_secret' || activeSecret === 'dev_secret' || activeSecret === 'default_secret' || activeSecret === 'secret' || activeSecret === 'dev_secret_change_in_production')) {
(activeSecret === 'test_secret' || activeSecret === 'dev_secret' || activeSecret === 'default_secret' || activeSecret === 'secret' || activeSecret === 'dev_secret_change_in_production' || activeSecret === 'change_in_production' || activeSecret === 'development_secret')) {
console.error('Security Error: Weak JWT_SECRET detected in production environment.');
return res.status(500).json({ error: 'Internal server configuration error: Weak JWT secret in production.' });
}
Expand All @@ -68,7 +68,7 @@ const authenticateToken = (req, res, next) => {
*/
function extractSiteId(payload) {
if (!payload) return null;
return payload.site_id || payload.siteId || payload.location_id || payload.locationId || null;
return payload.site_id || payload.siteId || payload.location_id || payload.locationId || (payload.metadata ? extractSiteId(payload.metadata) : null) || null;
}

/**
Expand Down Expand Up @@ -329,7 +329,7 @@ async function getDynamicMultiplier(isoRaw, actionType, isVppEvent = false) {
app.get('/health', (req, res) => {
res.json({
service: 'token-engine',
version: '4.3.9',
version: '4.4.0',
status: 'healthy',
layer: 'L10',
platform: 'v10.1.6'
Expand Down Expand Up @@ -367,7 +367,7 @@ app.get('/data/training/rewards', authenticateToken, async (req, res) => {
res.json({
count: result.rows.length,
data: result.rows,
source: 'L10_TOKEN_ENGINE_V4.3.9',
source: 'L10_TOKEN_ENGINE_V4.4.0',
fidelity_tier: 'SENTINEL'
});
} catch (error) {
Expand Down Expand Up @@ -413,7 +413,7 @@ async function start() {
}

if (topic === 'DER_ALARM_REPORTED') {
const alarmRegion = (payload.iso_region || 'SYSTEM_WIDE').toUpperCase().replace(/-/g, '');
const alarmRegion = (payload.iso_region || payload.isoRegion || payload.iso || payload.region || 'SYSTEM_WIDE').toUpperCase().replace(/-/g, '');
const alarms = payload.alarms || [];
console.log(`🚨 [L10 Alarm Tracker] DER Alarm reported from ${payload.chargePointId} in ${alarmRegion}. Count: ${alarms.length}`);

Expand Down
2 changes: 1 addition & 1 deletion services/10-token-engine/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@migrid/token-engine",
"version": "4.3.9",
"version": "4.4.0",
"main": "index.js",
"dependencies": {
"axios": "^1.6.0",
Expand Down
25 changes: 25 additions & 0 deletions services/10-token-engine/tests/security_hardening.test.js
Original file line number Diff line number Diff line change
Expand Up @@ -125,4 +125,29 @@ describe('L10 Token Engine Security Hardening', () => {
}
process.env.JWT_SECRET = originalJwtSecret;
});

test('GET /data/training/rewards should return 500 in production if development_secret weak secret is used', async () => {
const originalNodeEnv = process.env.NODE_ENV;
const originalJwtSecret = process.env.JWT_SECRET;

process.env.NODE_ENV = 'production';
process.env.JWT_SECRET = 'development_secret';

const token = jwt.sign({ driver_id: 'admin-1' }, process.env.JWT_SECRET);

const response = await request(app)
.get('/data/training/rewards')
.set('Authorization', `Bearer ${token}`);

expect(response.status).toBe(500);
expect(response.body.error).toContain('Internal server configuration error');

// Restore
if (originalNodeEnv === undefined) {
delete process.env.NODE_ENV;
} else {
process.env.NODE_ENV = originalNodeEnv;
}
process.env.JWT_SECRET = originalJwtSecret;
});
});
74 changes: 74 additions & 0 deletions services/10-token-engine/verify_l10_v4_4_0.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
/**
* Verification Script for L10 Token Engine v4.4.0
* Verifies versioning, health status, security hardening, metadata site extraction, and core utility logic.
*/

const { app } = require('./index');
const request = require('supertest');
const fs = require('fs');
const path = require('path');

async function verify() {
console.log('🚀 Starting L10 v4.4.0 Verification...');

// 1. Verify Health Check and Versioning
try {
const res = await request(app).get('/health');
if (res.status === 200 && res.body.version === '4.4.0') {
console.log('✅ Health Check: PASSED (Version 4.4.0)');
} else {
console.error('❌ Health Check: FAILED', res.body);
process.exit(1);
}
} catch (err) {
console.error('❌ Health Check Request Error:', err.message);
process.exit(1);
}

// 2. Duplicate Function Check
const indexSource = fs.readFileSync(path.join(__dirname, 'index.js'), 'utf8');
const occurrences = (indexSource.match(/function extractSiteId/g) || []).length;

if (occurrences === 1) {
console.log('✅ Duplicate Function Check: PASSED (Only 1 extractSiteId found)');
} else {
console.error(`❌ Duplicate Function Check: FAILED (${occurrences} found)`);
process.exit(1);
}

// 3. AI Export Standard Check
if (indexSource.includes("source: 'L10_TOKEN_ENGINE_V4.4.0'")) {
console.log('✅ AI Export Standard: PASSED (Version string updated)');
} else {
console.error('❌ AI Export Standard: FAILED (Version string not updated)');
process.exit(1);
}

// 4. Nested Metadata Site ID Extraction Check
if (indexSource.includes("payload.metadata ? extractSiteId(payload.metadata)")) {
console.log('✅ Metadata Site Extraction: PASSED (Metadata fallback configured)');
} else {
console.error('❌ Metadata Site Extraction: FAILED');
process.exit(1);
}

// 5. DER Alarm Multi-Format Region Extraction Check
if (indexSource.includes("payload.iso_region || payload.isoRegion || payload.iso || payload.region")) {
console.log('✅ DER Alarm Region Extraction: PASSED (Multi-key fallback configured)');
} else {
console.error('❌ DER Alarm Region Extraction: FAILED');
process.exit(1);
}

// 6. Security Hardening Checks for Insecure Secrets
if (indexSource.includes("activeSecret === 'development_secret'")) {
console.log("✅ Weak Secret Hardening: PASSED ('development_secret' rejected in production)");
} else {
console.error('❌ Weak Secret Hardening: FAILED');
process.exit(1);
}

console.log('🎉 L10 v4.4.0 Verification COMPLETE: ALL SYSTEMS NOMINAL');
}

verify();