Compare commits
14 Commits
feature/is
...
feature/is
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
2f9efdad64 | ||
|
|
6551d7af79 | ||
| 7515a5a314 | |||
|
|
254b543c89 | ||
|
|
917b68eb81 | ||
| 2becbddb4a | |||
|
|
05e8986ff5 | ||
| 3c676c2b8d | |||
|
|
3dd222bd3b | ||
| f4e6b609a4 | |||
|
|
9c5bd254b5 | ||
| 5c9261ce5b | |||
| ef4305cfc3 | |||
|
|
b26ff0c1b8 |
1
.gitignore
vendored
1
.gitignore
vendored
@@ -174,3 +174,4 @@ cython_debug/
|
|||||||
# PyPI configuration file
|
# PyPI configuration file
|
||||||
.pypirc
|
.pypirc
|
||||||
|
|
||||||
|
data/
|
||||||
|
|||||||
133
CLAUDE.md
133
CLAUDE.md
@@ -1,79 +1,98 @@
|
|||||||
# CLAUDE.md
|
# The Ouroboros
|
||||||
|
|
||||||
This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
|
AI-powered trading agent for global stock markets with self-evolution capabilities.
|
||||||
|
|
||||||
## Git Workflow Policy
|
## Quick Start
|
||||||
|
|
||||||
**CRITICAL: All code changes MUST follow this workflow. Direct pushes to `main` are ABSOLUTELY PROHIBITED.**
|
|
||||||
|
|
||||||
1. **Create Gitea Issue First** — All features, bug fixes, and policy changes require a Gitea issue before any code is written
|
|
||||||
2. **Create Feature Branch** — Branch from `main` using format `feature/issue-{N}-{short-description}`
|
|
||||||
3. **Implement Changes** — Write code, tests, and documentation on the feature branch
|
|
||||||
4. **Create Pull Request** — Submit PR to `main` branch referencing the issue number
|
|
||||||
5. **Review & Merge** — After approval, merge via PR (squash or merge commit)
|
|
||||||
|
|
||||||
**Never commit directly to `main`.** This policy applies to all changes, no exceptions.
|
|
||||||
|
|
||||||
## Build & Test Commands
|
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
# Install all dependencies (production + dev)
|
# Setup
|
||||||
pip install ".[dev]"
|
pip install -e ".[dev]"
|
||||||
|
cp .env.example .env
|
||||||
|
# Edit .env with your KIS and Gemini API credentials
|
||||||
|
|
||||||
# Run full test suite with coverage
|
# Test
|
||||||
pytest -v --cov=src --cov-report=term-missing
|
pytest -v --cov=src
|
||||||
|
|
||||||
# Run a single test file
|
# Run (paper trading)
|
||||||
pytest tests/test_risk.py -v
|
|
||||||
|
|
||||||
# Run a single test by name
|
|
||||||
pytest tests/test_brain.py -k "test_parse_valid_json" -v
|
|
||||||
|
|
||||||
# Lint
|
|
||||||
ruff check src/ tests/
|
|
||||||
|
|
||||||
# Type check (strict mode, non-blocking in CI)
|
|
||||||
mypy src/ --strict
|
|
||||||
|
|
||||||
# Run the trading agent
|
|
||||||
python -m src.main --mode=paper
|
python -m src.main --mode=paper
|
||||||
|
|
||||||
# Docker
|
|
||||||
docker compose up -d ouroboros # Run agent
|
|
||||||
docker compose --profile test up test # Run tests in container
|
|
||||||
```
|
```
|
||||||
|
|
||||||
## Architecture
|
## Documentation
|
||||||
|
|
||||||
Self-evolving AI trading agent for Korean stock markets (KIS API). The main loop in `src/main.py` orchestrates four components in a 60-second cycle per stock:
|
- **[Workflow Guide](docs/workflow.md)** — Git workflow policy and agent-based development
|
||||||
|
- **[Command Reference](docs/commands.md)** — Common failures, build commands, troubleshooting
|
||||||
|
- **[Architecture](docs/architecture.md)** — System design, components, data flow
|
||||||
|
- **[Context Tree](docs/context-tree.md)** — L1-L7 hierarchical memory system
|
||||||
|
- **[Testing](docs/testing.md)** — Test structure, coverage requirements, writing tests
|
||||||
|
- **[Agent Policies](docs/agents.md)** — Prime directives, constraints, prohibited actions
|
||||||
|
|
||||||
1. **Broker** (`src/broker/kis_api.py`) — Async KIS API client with automatic OAuth token refresh, leaky-bucket rate limiter (10 RPS), and POST body hash-key signing. Uses a custom SSL context with disabled hostname verification for the VTS (virtual trading) endpoint due to a known certificate mismatch.
|
## Core Principles
|
||||||
|
|
||||||
2. **Brain** (`src/brain/gemini_client.py`) — Sends structured prompts to Google Gemini, parses JSON responses into `TradeDecision` objects. Forces HOLD when confidence < threshold (default 80). Falls back to safe HOLD on any parse/API error.
|
1. **Safety First** — Risk manager is READ-ONLY and enforces circuit breakers
|
||||||
|
2. **Test Everything** — 80% coverage minimum, all changes require tests
|
||||||
|
3. **Issue-Driven Development** — All work goes through Gitea issues → feature branches → PRs
|
||||||
|
4. **Agent Specialization** — Use dedicated agents for design, coding, testing, docs, review
|
||||||
|
|
||||||
3. **Risk Manager** (`src/core/risk_manager.py`) — **READ-ONLY by policy** (see `docs/agents.md`). Circuit breaker halts all trading via `SystemExit` when daily P&L drops below -3.0%. Fat-finger check rejects orders exceeding 30% of available cash.
|
## Project Structure
|
||||||
|
|
||||||
4. **Evolution** (`src/evolution/optimizer.py`) — Analyzes high-confidence losing trades from SQLite, asks Gemini to generate new `BaseStrategy` subclasses, validates them by running the full pytest suite, and simulates PR creation.
|
```
|
||||||
|
src/
|
||||||
|
├── broker/ # KIS API client (domestic + overseas)
|
||||||
|
├── brain/ # Gemini AI decision engine
|
||||||
|
├── core/ # Risk manager (READ-ONLY)
|
||||||
|
├── evolution/ # Self-improvement optimizer
|
||||||
|
├── markets/ # Market schedules and timezone handling
|
||||||
|
├── db.py # SQLite trade logging
|
||||||
|
├── main.py # Trading loop orchestrator
|
||||||
|
└── config.py # Settings (from .env)
|
||||||
|
|
||||||
**Data flow per cycle:** Fetch orderbook + balance → calculate P&L → get Gemini decision → validate with risk manager → execute order → log to SQLite (`src/db.py`).
|
tests/ # 54 tests across 4 files
|
||||||
|
docs/ # Extended documentation
|
||||||
|
```
|
||||||
|
|
||||||
## Key Constraints (from `docs/agents.md`)
|
## Key Commands
|
||||||
|
|
||||||
- `core/risk_manager.py` is **READ-ONLY**. Changes require human approval.
|
```bash
|
||||||
- Circuit breaker threshold (-3.0%) may only be made stricter, never relaxed.
|
pytest -v --cov=src # Run tests with coverage
|
||||||
- Fat-finger protection (30% max order size) must always be enforced.
|
ruff check src/ tests/ # Lint
|
||||||
- Confidence < 80 **must** force HOLD — this rule cannot be weakened.
|
mypy src/ --strict # Type check
|
||||||
- All code changes require corresponding tests. Coverage must stay >= 80%.
|
|
||||||
- Generated strategies must pass the full test suite before activation.
|
|
||||||
|
|
||||||
## Configuration
|
python -m src.main --mode=paper # Paper trading
|
||||||
|
python -m src.main --mode=live # Live trading (⚠️ real money)
|
||||||
|
|
||||||
Pydantic Settings loaded from `.env` (see `.env.example`). Required vars: `KIS_APP_KEY`, `KIS_APP_SECRET`, `KIS_ACCOUNT_NO` (format `XXXXXXXX-XX`), `GEMINI_API_KEY`. Tests use in-memory SQLite (`DB_PATH=":memory:"`) and dummy credentials via `tests/conftest.py`.
|
# Gitea workflow (requires tea CLI)
|
||||||
|
YES="" ~/bin/tea issues create --repo jihoson/The-Ouroboros --title "..." --description "..."
|
||||||
|
YES="" ~/bin/tea pulls create --head feature-branch --base main --title "..." --description "..."
|
||||||
|
```
|
||||||
|
|
||||||
## Test Structure
|
## Markets Supported
|
||||||
|
|
||||||
35 tests across three files. `asyncio_mode = "auto"` in pyproject.toml — async tests need no special decorator. The `settings` fixture in `conftest.py` provides safe defaults with test credentials and in-memory DB.
|
- 🇰🇷 Korea (KRX)
|
||||||
|
- 🇺🇸 United States (NASDAQ, NYSE, AMEX)
|
||||||
|
- 🇯🇵 Japan (TSE)
|
||||||
|
- 🇭🇰 Hong Kong (SEHK)
|
||||||
|
- 🇨🇳 China (Shanghai, Shenzhen)
|
||||||
|
- 🇻🇳 Vietnam (Hanoi, HCM)
|
||||||
|
|
||||||
- `test_risk.py` (11) — Circuit breaker boundaries, fat-finger edge cases
|
Markets auto-detected based on timezone and enabled in `ENABLED_MARKETS` env variable.
|
||||||
- `test_broker.py` (6) — Token lifecycle, rate limiting, hash keys, network errors
|
|
||||||
- `test_brain.py` (18) — JSON parsing, confidence threshold, malformed responses, prompt construction
|
## Critical Constraints
|
||||||
|
|
||||||
|
⚠️ **Non-Negotiable Rules** (see [docs/agents.md](docs/agents.md)):
|
||||||
|
|
||||||
|
- `src/core/risk_manager.py` is **READ-ONLY** — changes require human approval
|
||||||
|
- Circuit breaker at -3.0% P&L — may only be made **stricter**
|
||||||
|
- Fat-finger protection: max 30% of cash per order — always enforced
|
||||||
|
- Confidence < 80 → force HOLD — cannot be weakened
|
||||||
|
- All code changes → corresponding tests → coverage ≥ 80%
|
||||||
|
|
||||||
|
## Contributing
|
||||||
|
|
||||||
|
See [docs/workflow.md](docs/workflow.md) for the complete development process.
|
||||||
|
|
||||||
|
**TL;DR:**
|
||||||
|
1. Create issue in Gitea
|
||||||
|
2. Create feature branch: `feature/issue-N-description`
|
||||||
|
3. Implement with tests
|
||||||
|
4. Open PR
|
||||||
|
5. Merge after review
|
||||||
|
|||||||
191
docs/architecture.md
Normal file
191
docs/architecture.md
Normal file
@@ -0,0 +1,191 @@
|
|||||||
|
# System Architecture
|
||||||
|
|
||||||
|
## Overview
|
||||||
|
|
||||||
|
Self-evolving AI trading agent for global stock markets via KIS (Korea Investment & Securities) API. The main loop in `src/main.py` orchestrates four components in a 60-second cycle per stock across multiple markets.
|
||||||
|
|
||||||
|
## Core Components
|
||||||
|
|
||||||
|
### 1. Broker (`src/broker/`)
|
||||||
|
|
||||||
|
**KISBroker** (`kis_api.py`) — Async KIS API client for domestic Korean market
|
||||||
|
|
||||||
|
- Automatic OAuth token refresh (valid for 24 hours)
|
||||||
|
- Leaky-bucket rate limiter (10 requests per second)
|
||||||
|
- POST body hash-key signing for order authentication
|
||||||
|
- Custom SSL context with disabled hostname verification for VTS (virtual trading) endpoint due to known certificate mismatch
|
||||||
|
|
||||||
|
**OverseasBroker** (`overseas.py`) — KIS overseas stock API wrapper
|
||||||
|
|
||||||
|
- Reuses KISBroker infrastructure (session, token, rate limiter) via composition
|
||||||
|
- Supports 9 global markets: US (NASDAQ/NYSE/AMEX), Japan, Hong Kong, China (Shanghai/Shenzhen), Vietnam (Hanoi/HCM)
|
||||||
|
- Different API endpoints for overseas price/balance/order operations
|
||||||
|
|
||||||
|
**Market Schedule** (`src/markets/schedule.py`) — Timezone-aware market management
|
||||||
|
|
||||||
|
- `MarketInfo` dataclass with timezone, trading hours, lunch breaks
|
||||||
|
- Automatic DST handling via `zoneinfo.ZoneInfo`
|
||||||
|
- `is_market_open()` checks weekends, trading hours, lunch breaks
|
||||||
|
- `get_open_markets()` returns currently active markets
|
||||||
|
- `get_next_market_open()` finds next market to open and when
|
||||||
|
|
||||||
|
### 2. Brain (`src/brain/gemini_client.py`)
|
||||||
|
|
||||||
|
**GeminiClient** — AI decision engine powered by Google Gemini
|
||||||
|
|
||||||
|
- Constructs structured prompts from market data
|
||||||
|
- Parses JSON responses into `TradeDecision` objects (`action`, `confidence`, `rationale`)
|
||||||
|
- Forces HOLD when confidence < threshold (default 80)
|
||||||
|
- Falls back to safe HOLD on any parse/API error
|
||||||
|
- Handles markdown-wrapped JSON, malformed responses, invalid actions
|
||||||
|
|
||||||
|
### 3. Risk Manager (`src/core/risk_manager.py`)
|
||||||
|
|
||||||
|
**RiskManager** — Safety circuit breaker and order validation
|
||||||
|
|
||||||
|
⚠️ **READ-ONLY by policy** (see [`docs/agents.md`](./agents.md))
|
||||||
|
|
||||||
|
- **Circuit Breaker**: Halts all trading via `SystemExit` when daily P&L drops below -3.0%
|
||||||
|
- Threshold may only be made stricter, never relaxed
|
||||||
|
- Calculated as `(total_eval - purchase_total) / purchase_total * 100`
|
||||||
|
- **Fat-Finger Protection**: Rejects orders exceeding 30% of available cash
|
||||||
|
- Must always be enforced, cannot be disabled
|
||||||
|
|
||||||
|
### 4. Evolution (`src/evolution/optimizer.py`)
|
||||||
|
|
||||||
|
**StrategyOptimizer** — Self-improvement loop
|
||||||
|
|
||||||
|
- Analyzes high-confidence losing trades from SQLite
|
||||||
|
- Asks Gemini to generate new `BaseStrategy` subclasses
|
||||||
|
- Validates generated strategies by running full pytest suite
|
||||||
|
- Simulates PR creation for human review
|
||||||
|
- Only activates strategies that pass all tests
|
||||||
|
|
||||||
|
## Data Flow
|
||||||
|
|
||||||
|
```
|
||||||
|
┌─────────────────────────────────────────────────────────────┐
|
||||||
|
│ Main Loop (60s cycle per stock, per market) │
|
||||||
|
└─────────────────────────────────────────────────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Market Schedule Check │
|
||||||
|
│ - Get open markets │
|
||||||
|
│ - Filter by enabled markets │
|
||||||
|
│ - Wait if all closed │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Broker: Fetch Market Data │
|
||||||
|
│ - Domestic: orderbook + balance │
|
||||||
|
│ - Overseas: price + balance │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Calculate P&L │
|
||||||
|
│ pnl_pct = (eval - cost) / cost │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Brain: Get Decision │
|
||||||
|
│ - Build prompt with market data │
|
||||||
|
│ - Call Gemini API │
|
||||||
|
│ - Parse JSON response │
|
||||||
|
│ - Return TradeDecision │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Risk Manager: Validate Order │
|
||||||
|
│ - Check circuit breaker │
|
||||||
|
│ - Check fat-finger limit │
|
||||||
|
│ - Raise if validation fails │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Broker: Execute Order │
|
||||||
|
│ - Domestic: send_order() │
|
||||||
|
│ - Overseas: send_overseas_order() │
|
||||||
|
└──────────────────┬────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌──────────────────────────────────┐
|
||||||
|
│ Database: Log Trade │
|
||||||
|
│ - SQLite (data/trades.db) │
|
||||||
|
│ - Track: action, confidence, │
|
||||||
|
│ rationale, market, exchange │
|
||||||
|
└───────────────────────────────────┘
|
||||||
|
```
|
||||||
|
|
||||||
|
## Database Schema
|
||||||
|
|
||||||
|
**SQLite** (`src/db.py`)
|
||||||
|
|
||||||
|
```sql
|
||||||
|
CREATE TABLE trades (
|
||||||
|
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||||
|
timestamp TEXT NOT NULL,
|
||||||
|
stock_code TEXT NOT NULL,
|
||||||
|
action TEXT NOT NULL, -- BUY | SELL | HOLD
|
||||||
|
confidence INTEGER NOT NULL, -- 0-100
|
||||||
|
rationale TEXT,
|
||||||
|
quantity INTEGER,
|
||||||
|
price REAL,
|
||||||
|
pnl REAL DEFAULT 0.0,
|
||||||
|
market TEXT DEFAULT 'KR', -- KR | US_NASDAQ | JP | etc.
|
||||||
|
exchange_code TEXT DEFAULT 'KRX' -- KRX | NASD | NYSE | etc.
|
||||||
|
);
|
||||||
|
```
|
||||||
|
|
||||||
|
Auto-migration: Adds `market` and `exchange_code` columns if missing for backward compatibility.
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
**Pydantic Settings** (`src/config.py`)
|
||||||
|
|
||||||
|
Loaded from `.env` file:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Required
|
||||||
|
KIS_APP_KEY=your_app_key
|
||||||
|
KIS_APP_SECRET=your_app_secret
|
||||||
|
KIS_ACCOUNT_NO=XXXXXXXX-XX
|
||||||
|
GEMINI_API_KEY=your_gemini_key
|
||||||
|
|
||||||
|
# Optional
|
||||||
|
MODE=paper # paper | live
|
||||||
|
DB_PATH=data/trades.db
|
||||||
|
CONFIDENCE_THRESHOLD=80
|
||||||
|
MAX_LOSS_PCT=3.0
|
||||||
|
MAX_ORDER_PCT=30.0
|
||||||
|
ENABLED_MARKETS=KR,US_NASDAQ # Comma-separated market codes
|
||||||
|
```
|
||||||
|
|
||||||
|
Tests use in-memory SQLite (`DB_PATH=":memory:"`) and dummy credentials via `tests/conftest.py`.
|
||||||
|
|
||||||
|
## Error Handling
|
||||||
|
|
||||||
|
### Connection Errors (Broker API)
|
||||||
|
- Retry with exponential backoff (2^attempt seconds)
|
||||||
|
- Max 3 retries per stock
|
||||||
|
- After exhaustion, skip stock and continue with next
|
||||||
|
|
||||||
|
### API Quota Errors (Gemini)
|
||||||
|
- Return safe HOLD decision with confidence=0
|
||||||
|
- Log error but don't crash
|
||||||
|
- Agent continues trading on next cycle
|
||||||
|
|
||||||
|
### Circuit Breaker Tripped
|
||||||
|
- Immediately halt via `SystemExit`
|
||||||
|
- Log critical message
|
||||||
|
- Requires manual intervention to restart
|
||||||
|
|
||||||
|
### Market Closed
|
||||||
|
- Wait until next market opens
|
||||||
|
- Use `get_next_market_open()` to calculate wait time
|
||||||
|
- Sleep until market open time
|
||||||
156
docs/commands.md
Normal file
156
docs/commands.md
Normal file
@@ -0,0 +1,156 @@
|
|||||||
|
# Command Reference
|
||||||
|
|
||||||
|
## Common Command Failures
|
||||||
|
|
||||||
|
**Critical: Learn from failures. Never repeat the same failed command without modification.**
|
||||||
|
|
||||||
|
### tea CLI (Gitea Command Line Tool)
|
||||||
|
|
||||||
|
#### ❌ TTY Error - Interactive Confirmation Fails
|
||||||
|
```bash
|
||||||
|
~/bin/tea issues create --repo X --title "Y" --description "Z"
|
||||||
|
# Error: huh: could not open a new TTY: open /dev/tty: no such device or address
|
||||||
|
```
|
||||||
|
**💡 Reason:** tea tries to open `/dev/tty` for interactive confirmation prompts, which is unavailable in non-interactive environments.
|
||||||
|
|
||||||
|
**✅ Solution:** Use `YES=""` environment variable to bypass confirmation
|
||||||
|
```bash
|
||||||
|
YES="" ~/bin/tea issues create --repo jihoson/The-Ouroboros --title "Title" --description "Body"
|
||||||
|
YES="" ~/bin/tea issues edit <number> --repo jihoson/The-Ouroboros --description "Updated body"
|
||||||
|
YES="" ~/bin/tea pulls create --repo jihoson/The-Ouroboros --head feature-branch --base main --title "Title" --description "Body"
|
||||||
|
```
|
||||||
|
|
||||||
|
**📝 Notes:**
|
||||||
|
- Always set default login: `~/bin/tea login default local`
|
||||||
|
- Use `--repo jihoson/The-Ouroboros` when outside repo directory
|
||||||
|
- tea is preferred over direct Gitea API calls for consistency
|
||||||
|
|
||||||
|
#### ❌ Wrong Parameter Name
|
||||||
|
```bash
|
||||||
|
tea issues create --body "text"
|
||||||
|
# Error: flag provided but not defined: -body
|
||||||
|
```
|
||||||
|
**💡 Reason:** Parameter is `--description`, not `--body`.
|
||||||
|
|
||||||
|
**✅ Solution:** Use correct parameter name
|
||||||
|
```bash
|
||||||
|
YES="" ~/bin/tea issues create --description "text"
|
||||||
|
```
|
||||||
|
|
||||||
|
### Gitea API (Direct HTTP Calls)
|
||||||
|
|
||||||
|
#### ❌ Wrong Hostname
|
||||||
|
```bash
|
||||||
|
curl http://gitea.local:3000/api/v1/...
|
||||||
|
# Error: Could not resolve host: gitea.local
|
||||||
|
```
|
||||||
|
**💡 Reason:** Gitea instance runs on `localhost:3000`, not `gitea.local`.
|
||||||
|
|
||||||
|
**✅ Solution:** Use correct hostname (but prefer tea CLI)
|
||||||
|
```bash
|
||||||
|
curl http://localhost:3000/api/v1/repos/jihoson/The-Ouroboros/issues \
|
||||||
|
-H "Authorization: token $GITEA_TOKEN" \
|
||||||
|
-H "Content-Type: application/json" \
|
||||||
|
-d '{"title":"...", "body":"..."}'
|
||||||
|
```
|
||||||
|
|
||||||
|
**📝 Notes:**
|
||||||
|
- Prefer `tea` CLI over direct API calls
|
||||||
|
- Only use curl for operations tea doesn't support
|
||||||
|
|
||||||
|
### Git Commands
|
||||||
|
|
||||||
|
#### ❌ User Not Configured
|
||||||
|
```bash
|
||||||
|
git commit -m "message"
|
||||||
|
# Error: Author identity unknown
|
||||||
|
```
|
||||||
|
**💡 Reason:** Git user.name and user.email not set.
|
||||||
|
|
||||||
|
**✅ Solution:** Configure git user
|
||||||
|
```bash
|
||||||
|
git config user.name "agentson"
|
||||||
|
git config user.email "agentson@localhost"
|
||||||
|
```
|
||||||
|
|
||||||
|
#### ❌ Permission Denied on Push
|
||||||
|
```bash
|
||||||
|
git push origin branch
|
||||||
|
# Error: User permission denied for writing
|
||||||
|
```
|
||||||
|
**💡 Reason:** Repository access token lacks write permissions or user lacks repo write access.
|
||||||
|
|
||||||
|
**✅ Solution:**
|
||||||
|
1. Verify user has write access to repository (admin grants this)
|
||||||
|
2. Ensure git credential has correct token with `write:repository` scope
|
||||||
|
3. Check remote URL uses correct authentication
|
||||||
|
|
||||||
|
### Python/Pytest
|
||||||
|
|
||||||
|
#### ❌ Module Import Error
|
||||||
|
```bash
|
||||||
|
pytest tests/test_foo.py
|
||||||
|
# ModuleNotFoundError: No module named 'src'
|
||||||
|
```
|
||||||
|
**💡 Reason:** Package not installed in development mode.
|
||||||
|
|
||||||
|
**✅ Solution:** Install package with dev dependencies
|
||||||
|
```bash
|
||||||
|
pip install -e ".[dev]"
|
||||||
|
```
|
||||||
|
|
||||||
|
#### ❌ Async Test Hangs
|
||||||
|
```python
|
||||||
|
async def test_something(): # Hangs forever
|
||||||
|
result = await async_function()
|
||||||
|
```
|
||||||
|
**💡 Reason:** Missing pytest-asyncio or wrong configuration.
|
||||||
|
|
||||||
|
**✅ Solution:** Already configured in pyproject.toml
|
||||||
|
```toml
|
||||||
|
[tool.pytest.ini_options]
|
||||||
|
asyncio_mode = "auto"
|
||||||
|
```
|
||||||
|
No decorator needed for async tests.
|
||||||
|
|
||||||
|
## Build & Test Commands
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Install all dependencies (production + dev)
|
||||||
|
pip install -e ".[dev]"
|
||||||
|
|
||||||
|
# Run full test suite with coverage
|
||||||
|
pytest -v --cov=src --cov-report=term-missing
|
||||||
|
|
||||||
|
# Run a single test file
|
||||||
|
pytest tests/test_risk.py -v
|
||||||
|
|
||||||
|
# Run a single test by name
|
||||||
|
pytest tests/test_brain.py -k "test_parse_valid_json" -v
|
||||||
|
|
||||||
|
# Lint
|
||||||
|
ruff check src/ tests/
|
||||||
|
|
||||||
|
# Type check (strict mode, non-blocking in CI)
|
||||||
|
mypy src/ --strict
|
||||||
|
|
||||||
|
# Run the trading agent
|
||||||
|
python -m src.main --mode=paper
|
||||||
|
|
||||||
|
# Docker
|
||||||
|
docker compose up -d ouroboros # Run agent
|
||||||
|
docker compose --profile test up test # Run tests in container
|
||||||
|
```
|
||||||
|
|
||||||
|
## Environment Setup
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Create .env file from example
|
||||||
|
cp .env.example .env
|
||||||
|
|
||||||
|
# Edit .env with your credentials
|
||||||
|
# Required: KIS_APP_KEY, KIS_APP_SECRET, KIS_ACCOUNT_NO, GEMINI_API_KEY
|
||||||
|
|
||||||
|
# Verify configuration
|
||||||
|
python -c "from src.config import Settings; print(Settings())"
|
||||||
|
```
|
||||||
338
docs/context-tree.md
Normal file
338
docs/context-tree.md
Normal file
@@ -0,0 +1,338 @@
|
|||||||
|
# Context Tree: Multi-Layered Memory Management
|
||||||
|
|
||||||
|
The context tree implements **Pillar 2** of The Ouroboros: hierarchical memory management across 7 time horizons, from real-time market data to generational trading wisdom.
|
||||||
|
|
||||||
|
## Overview
|
||||||
|
|
||||||
|
Instead of a flat memory structure, The Ouroboros maintains a **7-tier context tree** where each layer represents a different time horizon and level of abstraction:
|
||||||
|
|
||||||
|
```
|
||||||
|
L1 (Legacy) ← Cumulative wisdom across generations
|
||||||
|
↑
|
||||||
|
L2 (Annual) ← Yearly performance metrics
|
||||||
|
↑
|
||||||
|
L3 (Quarterly) ← Quarterly strategy adjustments
|
||||||
|
↑
|
||||||
|
L4 (Monthly) ← Monthly portfolio rebalancing
|
||||||
|
↑
|
||||||
|
L5 (Weekly) ← Weekly stock selection
|
||||||
|
↑
|
||||||
|
L6 (Daily) ← Daily trade logs
|
||||||
|
↑
|
||||||
|
L7 (Real-time) ← Live market data
|
||||||
|
```
|
||||||
|
|
||||||
|
Data flows **bottom-up**: real-time trades aggregate into daily summaries, which roll up to weekly, then monthly, quarterly, annual, and finally into permanent legacy knowledge.
|
||||||
|
|
||||||
|
## The 7 Layers
|
||||||
|
|
||||||
|
### L7: Real-time
|
||||||
|
**Retention**: 7 days
|
||||||
|
**Timeframe format**: `YYYY-MM-DD` (same-day)
|
||||||
|
**Content**: Current positions, live quotes, orderbook snapshots, tick-by-tick volatility
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Immediate execution decisions
|
||||||
|
- Stop-loss triggers
|
||||||
|
- Real-time P&L tracking
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `current_position_{stock_code}`: Current holdings
|
||||||
|
- `live_price_{stock_code}`: Latest quote
|
||||||
|
- `volatility_5m_{stock_code}`: 5-minute rolling volatility
|
||||||
|
|
||||||
|
### L6: Daily
|
||||||
|
**Retention**: 90 days
|
||||||
|
**Timeframe format**: `YYYY-MM-DD`
|
||||||
|
**Content**: Daily trade logs, end-of-day P&L, market summaries, decision accuracy
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Daily performance review
|
||||||
|
- Identify patterns in recent trading
|
||||||
|
- Backtest strategy adjustments
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `total_pnl`: Daily profit/loss
|
||||||
|
- `trade_count`: Number of trades
|
||||||
|
- `win_rate`: Percentage of profitable trades
|
||||||
|
- `avg_confidence`: Average Gemini confidence
|
||||||
|
|
||||||
|
### L5: Weekly
|
||||||
|
**Retention**: 1 year
|
||||||
|
**Timeframe format**: `YYYY-Www` (ISO week, e.g., `2026-W06`)
|
||||||
|
**Content**: Weekly stock selection, sector rotation, volatility regime classification
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Weekly strategy adjustment
|
||||||
|
- Sector momentum tracking
|
||||||
|
- Identify hot/cold markets
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `weekly_pnl`: Week's total P&L
|
||||||
|
- `top_performers`: Best-performing stocks
|
||||||
|
- `sector_focus`: Dominant sectors
|
||||||
|
- `avg_confidence`: Weekly average confidence
|
||||||
|
|
||||||
|
### L4: Monthly
|
||||||
|
**Retention**: 2 years
|
||||||
|
**Timeframe format**: `YYYY-MM`
|
||||||
|
**Content**: Monthly portfolio rebalancing, risk exposure analysis, drawdown recovery
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Monthly performance reporting
|
||||||
|
- Risk exposure adjustment
|
||||||
|
- Correlation analysis
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `monthly_pnl`: Month's total P&L
|
||||||
|
- `sharpe_ratio`: Risk-adjusted return
|
||||||
|
- `max_drawdown`: Largest peak-to-trough decline
|
||||||
|
- `rebalancing_notes`: Manual insights
|
||||||
|
|
||||||
|
### L3: Quarterly
|
||||||
|
**Retention**: 3 years
|
||||||
|
**Timeframe format**: `YYYY-Qn` (e.g., `2026-Q1`)
|
||||||
|
**Content**: Quarterly strategy pivots, market phase detection (bull/bear/sideways), macro regime changes
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Strategic pivots (e.g., growth → value)
|
||||||
|
- Macro regime classification
|
||||||
|
- Long-term pattern recognition
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `quarterly_pnl`: Quarter's total P&L
|
||||||
|
- `market_phase`: Bull/Bear/Sideways
|
||||||
|
- `strategy_adjustments`: Major changes made
|
||||||
|
- `lessons_learned`: Key insights
|
||||||
|
|
||||||
|
### L2: Annual
|
||||||
|
**Retention**: 10 years
|
||||||
|
**Timeframe format**: `YYYY`
|
||||||
|
**Content**: Yearly returns, Sharpe ratio, max drawdown, win rate, strategy effectiveness
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Annual performance review
|
||||||
|
- Multi-year trend analysis
|
||||||
|
- Strategy benchmarking
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `annual_pnl`: Year's total P&L
|
||||||
|
- `sharpe_ratio`: Annual risk-adjusted return
|
||||||
|
- `win_rate`: Yearly win percentage
|
||||||
|
- `best_strategy`: Most successful strategy
|
||||||
|
- `worst_mistake`: Biggest lesson learned
|
||||||
|
|
||||||
|
### L1: Legacy
|
||||||
|
**Retention**: Forever
|
||||||
|
**Timeframe format**: `LEGACY` (single timeframe)
|
||||||
|
**Content**: Cumulative trading history, core principles, generational wisdom
|
||||||
|
|
||||||
|
**Use cases**:
|
||||||
|
- Long-term philosophy
|
||||||
|
- Foundational rules
|
||||||
|
- Lessons that transcend market cycles
|
||||||
|
|
||||||
|
**Example keys**:
|
||||||
|
- `total_pnl`: All-time profit/loss
|
||||||
|
- `years_traded`: Trading longevity
|
||||||
|
- `avg_annual_pnl`: Long-term average return
|
||||||
|
- `core_principles`: Immutable trading rules
|
||||||
|
- `greatest_trades`: Hall of fame
|
||||||
|
- `never_again`: Permanent warnings
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
### Setting Context
|
||||||
|
|
||||||
|
```python
|
||||||
|
from src.context import ContextLayer, ContextStore
|
||||||
|
from src.db import init_db
|
||||||
|
|
||||||
|
conn = init_db("data/ouroboros.db")
|
||||||
|
store = ContextStore(conn)
|
||||||
|
|
||||||
|
# Store daily P&L
|
||||||
|
store.set_context(
|
||||||
|
layer=ContextLayer.L6_DAILY,
|
||||||
|
timeframe="2026-02-04",
|
||||||
|
key="total_pnl",
|
||||||
|
value=1234.56
|
||||||
|
)
|
||||||
|
|
||||||
|
# Store weekly insight
|
||||||
|
store.set_context(
|
||||||
|
layer=ContextLayer.L5_WEEKLY,
|
||||||
|
timeframe="2026-W06",
|
||||||
|
key="top_performers",
|
||||||
|
value=["005930", "000660", "035720"] # JSON-serializable
|
||||||
|
)
|
||||||
|
|
||||||
|
# Store legacy wisdom
|
||||||
|
store.set_context(
|
||||||
|
layer=ContextLayer.L1_LEGACY,
|
||||||
|
timeframe="LEGACY",
|
||||||
|
key="core_principles",
|
||||||
|
value=[
|
||||||
|
"Cut losses fast",
|
||||||
|
"Let winners run",
|
||||||
|
"Never average down on losing positions"
|
||||||
|
]
|
||||||
|
)
|
||||||
|
```
|
||||||
|
|
||||||
|
### Retrieving Context
|
||||||
|
|
||||||
|
```python
|
||||||
|
# Get a specific value
|
||||||
|
pnl = store.get_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl")
|
||||||
|
# Returns: 1234.56
|
||||||
|
|
||||||
|
# Get all keys for a timeframe
|
||||||
|
daily_summary = store.get_all_contexts(ContextLayer.L6_DAILY, "2026-02-04")
|
||||||
|
# Returns: {"total_pnl": 1234.56, "trade_count": 10, "win_rate": 60.0, ...}
|
||||||
|
|
||||||
|
# Get all data for a layer (any timeframe)
|
||||||
|
all_daily = store.get_all_contexts(ContextLayer.L6_DAILY)
|
||||||
|
# Returns: {"total_pnl": 1234.56, "trade_count": 10, ...} (latest timeframes first)
|
||||||
|
|
||||||
|
# Get the latest timeframe
|
||||||
|
latest = store.get_latest_timeframe(ContextLayer.L6_DAILY)
|
||||||
|
# Returns: "2026-02-04"
|
||||||
|
```
|
||||||
|
|
||||||
|
### Automatic Aggregation
|
||||||
|
|
||||||
|
The `ContextAggregator` rolls up data from lower to higher layers:
|
||||||
|
|
||||||
|
```python
|
||||||
|
from src.context.aggregator import ContextAggregator
|
||||||
|
|
||||||
|
aggregator = ContextAggregator(conn)
|
||||||
|
|
||||||
|
# Aggregate daily metrics from trades
|
||||||
|
aggregator.aggregate_daily_from_trades("2026-02-04")
|
||||||
|
|
||||||
|
# Roll up weekly from daily
|
||||||
|
aggregator.aggregate_weekly_from_daily("2026-W06")
|
||||||
|
|
||||||
|
# Roll up all layers at once (bottom-up)
|
||||||
|
aggregator.run_all_aggregations()
|
||||||
|
```
|
||||||
|
|
||||||
|
**Aggregation schedule** (recommended):
|
||||||
|
- **L7 → L6**: Every midnight (daily rollup)
|
||||||
|
- **L6 → L5**: Every Sunday (weekly rollup)
|
||||||
|
- **L5 → L4**: First day of each month (monthly rollup)
|
||||||
|
- **L4 → L3**: First day of quarter (quarterly rollup)
|
||||||
|
- **L3 → L2**: January 1st (annual rollup)
|
||||||
|
- **L2 → L1**: On demand (major milestones)
|
||||||
|
|
||||||
|
### Context Cleanup
|
||||||
|
|
||||||
|
Expired contexts are automatically deleted based on retention policies:
|
||||||
|
|
||||||
|
```python
|
||||||
|
# Manual cleanup
|
||||||
|
deleted = store.cleanup_expired_contexts()
|
||||||
|
# Returns: {ContextLayer.L7_REALTIME: 42, ContextLayer.L6_DAILY: 15, ...}
|
||||||
|
```
|
||||||
|
|
||||||
|
**Retention policies** (defined in `src/context/layer.py`):
|
||||||
|
- L1: Forever
|
||||||
|
- L2: 10 years
|
||||||
|
- L3: 3 years
|
||||||
|
- L4: 2 years
|
||||||
|
- L5: 1 year
|
||||||
|
- L6: 90 days
|
||||||
|
- L7: 7 days
|
||||||
|
|
||||||
|
## Integration with Gemini Brain
|
||||||
|
|
||||||
|
The context tree provides hierarchical memory for decision-making:
|
||||||
|
|
||||||
|
```python
|
||||||
|
from src.brain.gemini_client import GeminiClient
|
||||||
|
|
||||||
|
# Build prompt with multi-layer context
|
||||||
|
def build_enhanced_prompt(stock_code: str, store: ContextStore) -> str:
|
||||||
|
# L7: Real-time data
|
||||||
|
current_price = store.get_context(ContextLayer.L7_REALTIME, "2026-02-04", f"live_price_{stock_code}")
|
||||||
|
|
||||||
|
# L6: Recent daily performance
|
||||||
|
yesterday_pnl = store.get_context(ContextLayer.L6_DAILY, "2026-02-03", "total_pnl")
|
||||||
|
|
||||||
|
# L5: Weekly trend
|
||||||
|
weekly_data = store.get_all_contexts(ContextLayer.L5_WEEKLY, "2026-W06")
|
||||||
|
|
||||||
|
# L1: Core principles
|
||||||
|
principles = store.get_context(ContextLayer.L1_LEGACY, "LEGACY", "core_principles")
|
||||||
|
|
||||||
|
return f"""
|
||||||
|
Analyze {stock_code} for trading decision.
|
||||||
|
|
||||||
|
Current price: {current_price}
|
||||||
|
Yesterday's P&L: {yesterday_pnl}
|
||||||
|
This week: {weekly_data}
|
||||||
|
|
||||||
|
Core principles:
|
||||||
|
{chr(10).join(f'- {p}' for p in principles)}
|
||||||
|
|
||||||
|
Decision (BUY/SELL/HOLD):
|
||||||
|
"""
|
||||||
|
```
|
||||||
|
|
||||||
|
## Database Schema
|
||||||
|
|
||||||
|
```sql
|
||||||
|
-- Context storage
|
||||||
|
CREATE TABLE contexts (
|
||||||
|
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||||
|
layer TEXT NOT NULL, -- L1_LEGACY, L2_ANNUAL, ..., L7_REALTIME
|
||||||
|
timeframe TEXT NOT NULL, -- "LEGACY", "2026", "2026-Q1", "2026-02", "2026-W06", "2026-02-04"
|
||||||
|
key TEXT NOT NULL, -- "total_pnl", "win_rate", "core_principles", etc.
|
||||||
|
value TEXT NOT NULL, -- JSON-serialized value
|
||||||
|
created_at TEXT NOT NULL, -- ISO 8601 timestamp
|
||||||
|
updated_at TEXT NOT NULL, -- ISO 8601 timestamp
|
||||||
|
UNIQUE(layer, timeframe, key)
|
||||||
|
);
|
||||||
|
|
||||||
|
-- Layer metadata
|
||||||
|
CREATE TABLE context_metadata (
|
||||||
|
layer TEXT PRIMARY KEY,
|
||||||
|
description TEXT NOT NULL,
|
||||||
|
retention_days INTEGER, -- NULL = keep forever
|
||||||
|
aggregation_source TEXT -- Parent layer for rollup
|
||||||
|
);
|
||||||
|
|
||||||
|
-- Indices for fast queries
|
||||||
|
CREATE INDEX idx_contexts_layer ON contexts(layer);
|
||||||
|
CREATE INDEX idx_contexts_timeframe ON contexts(timeframe);
|
||||||
|
CREATE INDEX idx_contexts_updated ON contexts(updated_at);
|
||||||
|
```
|
||||||
|
|
||||||
|
## Best Practices
|
||||||
|
|
||||||
|
1. **Write to leaf layers only** — Never manually write to L1-L5; let aggregation populate them
|
||||||
|
2. **Aggregate regularly** — Schedule aggregation jobs to keep higher layers fresh
|
||||||
|
3. **Query specific timeframes** — Use `get_context(layer, timeframe, key)` for precise retrieval
|
||||||
|
4. **Clean up periodically** — Run `cleanup_expired_contexts()` weekly to free space
|
||||||
|
5. **Preserve L1 forever** — Legacy wisdom should never expire
|
||||||
|
6. **Use JSON-serializable values** — Store dicts, lists, strings, numbers (not custom objects)
|
||||||
|
|
||||||
|
## Testing
|
||||||
|
|
||||||
|
See `tests/test_context.py` for comprehensive test coverage (18 tests, 100% coverage on context modules).
|
||||||
|
|
||||||
|
```bash
|
||||||
|
pytest tests/test_context.py -v
|
||||||
|
```
|
||||||
|
|
||||||
|
## References
|
||||||
|
|
||||||
|
- **Implementation**: `src/context/`
|
||||||
|
- `layer.py`: Layer definitions and metadata
|
||||||
|
- `store.py`: CRUD operations
|
||||||
|
- `aggregator.py`: Bottom-up aggregation logic
|
||||||
|
- **Database**: `src/db.py` (table initialization)
|
||||||
|
- **Tests**: `tests/test_context.py`
|
||||||
|
- **Related**: Pillar 2 (Multi-layered Context Management)
|
||||||
213
docs/testing.md
Normal file
213
docs/testing.md
Normal file
@@ -0,0 +1,213 @@
|
|||||||
|
# Testing Guidelines
|
||||||
|
|
||||||
|
## Test Structure
|
||||||
|
|
||||||
|
**54 tests** across four files. `asyncio_mode = "auto"` in pyproject.toml — async tests need no special decorator.
|
||||||
|
|
||||||
|
The `settings` fixture in `conftest.py` provides safe defaults with test credentials and in-memory DB.
|
||||||
|
|
||||||
|
### Test Files
|
||||||
|
|
||||||
|
#### `tests/test_risk.py` (11 tests)
|
||||||
|
- Circuit breaker boundaries
|
||||||
|
- Fat-finger edge cases
|
||||||
|
- P&L calculation edge cases
|
||||||
|
- Order validation logic
|
||||||
|
|
||||||
|
**Example:**
|
||||||
|
```python
|
||||||
|
def test_circuit_breaker_exact_threshold(risk_manager):
|
||||||
|
"""Circuit breaker should trip at exactly -3.0%."""
|
||||||
|
with pytest.raises(CircuitBreakerTripped):
|
||||||
|
risk_manager.validate_order(
|
||||||
|
current_pnl_pct=-3.0,
|
||||||
|
order_amount=1000,
|
||||||
|
total_cash=10000
|
||||||
|
)
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `tests/test_broker.py` (6 tests)
|
||||||
|
- OAuth token lifecycle
|
||||||
|
- Rate limiting enforcement
|
||||||
|
- Hash key generation
|
||||||
|
- Network error handling
|
||||||
|
- SSL context configuration
|
||||||
|
|
||||||
|
**Example:**
|
||||||
|
```python
|
||||||
|
async def test_rate_limiter(broker):
|
||||||
|
"""Rate limiter should delay requests to stay under 10 RPS."""
|
||||||
|
start = time.monotonic()
|
||||||
|
for _ in range(15): # 15 requests
|
||||||
|
await broker._rate_limiter.acquire()
|
||||||
|
elapsed = time.monotonic() - start
|
||||||
|
assert elapsed >= 1.0 # Should take at least 1 second
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `tests/test_brain.py` (18 tests)
|
||||||
|
- Valid JSON parsing
|
||||||
|
- Markdown-wrapped JSON handling
|
||||||
|
- Malformed JSON fallback
|
||||||
|
- Missing fields handling
|
||||||
|
- Invalid action validation
|
||||||
|
- Confidence threshold enforcement
|
||||||
|
- Empty response handling
|
||||||
|
- Prompt construction for different markets
|
||||||
|
|
||||||
|
**Example:**
|
||||||
|
```python
|
||||||
|
async def test_confidence_below_threshold_forces_hold(brain):
|
||||||
|
"""Decisions below confidence threshold should force HOLD."""
|
||||||
|
decision = brain.parse_response('{"action":"BUY","confidence":70,"rationale":"test"}')
|
||||||
|
assert decision.action == "HOLD"
|
||||||
|
assert decision.confidence == 70
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `tests/test_market_schedule.py` (19 tests)
|
||||||
|
- Market open/close logic
|
||||||
|
- Timezone handling (UTC, Asia/Seoul, America/New_York, etc.)
|
||||||
|
- DST (Daylight Saving Time) transitions
|
||||||
|
- Weekend handling
|
||||||
|
- Lunch break logic
|
||||||
|
- Multiple market filtering
|
||||||
|
- Next market open calculation
|
||||||
|
|
||||||
|
**Example:**
|
||||||
|
```python
|
||||||
|
def test_is_market_open_during_trading_hours():
|
||||||
|
"""Market should be open during regular trading hours."""
|
||||||
|
# KRX: 9:00-15:30 KST, no lunch break
|
||||||
|
market = MARKETS["KR"]
|
||||||
|
trading_time = datetime(2026, 2, 3, 10, 0, tzinfo=ZoneInfo("Asia/Seoul")) # Monday 10:00
|
||||||
|
assert is_market_open(market, trading_time) is True
|
||||||
|
```
|
||||||
|
|
||||||
|
## Coverage Requirements
|
||||||
|
|
||||||
|
**Minimum coverage: 80%**
|
||||||
|
|
||||||
|
Check coverage:
|
||||||
|
```bash
|
||||||
|
pytest -v --cov=src --cov-report=term-missing
|
||||||
|
```
|
||||||
|
|
||||||
|
Expected output:
|
||||||
|
```
|
||||||
|
Name Stmts Miss Cover Missing
|
||||||
|
-----------------------------------------------------------
|
||||||
|
src/brain/gemini_client.py 85 5 94% 165-169
|
||||||
|
src/broker/kis_api.py 120 12 90% ...
|
||||||
|
src/core/risk_manager.py 35 2 94% ...
|
||||||
|
src/db.py 25 1 96% ...
|
||||||
|
src/main.py 150 80 47% (excluded from CI)
|
||||||
|
src/markets/schedule.py 95 3 97% ...
|
||||||
|
-----------------------------------------------------------
|
||||||
|
TOTAL 510 103 80%
|
||||||
|
```
|
||||||
|
|
||||||
|
**Note:** `main.py` has lower coverage as it contains the main loop which is tested via integration/manual testing.
|
||||||
|
|
||||||
|
## Test Configuration
|
||||||
|
|
||||||
|
### `pyproject.toml`
|
||||||
|
```toml
|
||||||
|
[tool.pytest.ini_options]
|
||||||
|
asyncio_mode = "auto"
|
||||||
|
testpaths = ["tests"]
|
||||||
|
python_files = ["test_*.py"]
|
||||||
|
```
|
||||||
|
|
||||||
|
### `tests/conftest.py`
|
||||||
|
```python
|
||||||
|
@pytest.fixture
|
||||||
|
def settings() -> Settings:
|
||||||
|
"""Provide test settings with safe defaults."""
|
||||||
|
return Settings(
|
||||||
|
KIS_APP_KEY="test_key",
|
||||||
|
KIS_APP_SECRET="test_secret",
|
||||||
|
KIS_ACCOUNT_NO="12345678-01",
|
||||||
|
GEMINI_API_KEY="test_gemini_key",
|
||||||
|
MODE="paper",
|
||||||
|
DB_PATH=":memory:", # In-memory SQLite
|
||||||
|
CONFIDENCE_THRESHOLD=80,
|
||||||
|
ENABLED_MARKETS="KR",
|
||||||
|
)
|
||||||
|
```
|
||||||
|
|
||||||
|
## Writing New Tests
|
||||||
|
|
||||||
|
### Naming Convention
|
||||||
|
- Test files: `test_<module>.py`
|
||||||
|
- Test functions: `test_<feature>_<scenario>()`
|
||||||
|
- Use descriptive names that explain what is being tested
|
||||||
|
|
||||||
|
### Good Test Example
|
||||||
|
```python
|
||||||
|
async def test_send_order_with_market_price(broker, settings):
|
||||||
|
"""Market orders should use price=0 and ORD_DVSN='01'."""
|
||||||
|
# Arrange
|
||||||
|
stock_code = "005930"
|
||||||
|
order_type = "BUY"
|
||||||
|
quantity = 10
|
||||||
|
|
||||||
|
# Act
|
||||||
|
with patch.object(broker._session, 'post') as mock_post:
|
||||||
|
mock_post.return_value.__aenter__.return_value.status = 200
|
||||||
|
mock_post.return_value.__aenter__.return_value.json = AsyncMock(
|
||||||
|
return_value={"rt_cd": "0", "msg1": "OK"}
|
||||||
|
)
|
||||||
|
|
||||||
|
await broker.send_order(stock_code, order_type, quantity, price=0)
|
||||||
|
|
||||||
|
# Assert
|
||||||
|
call_args = mock_post.call_args
|
||||||
|
body = call_args.kwargs['json']
|
||||||
|
assert body['ORD_DVSN'] == '01' # Market order
|
||||||
|
assert body['ORD_UNPR'] == '0' # Price 0
|
||||||
|
```
|
||||||
|
|
||||||
|
### Test Checklist
|
||||||
|
- [ ] Test passes in isolation (`pytest tests/test_foo.py::test_bar -v`)
|
||||||
|
- [ ] Test has clear docstring explaining what it tests
|
||||||
|
- [ ] Arrange-Act-Assert structure
|
||||||
|
- [ ] Uses appropriate fixtures from conftest.py
|
||||||
|
- [ ] Mocks external dependencies (API calls, network)
|
||||||
|
- [ ] Tests edge cases and error conditions
|
||||||
|
- [ ] Doesn't rely on test execution order
|
||||||
|
|
||||||
|
## Running Tests
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# All tests
|
||||||
|
pytest -v
|
||||||
|
|
||||||
|
# Specific file
|
||||||
|
pytest tests/test_risk.py -v
|
||||||
|
|
||||||
|
# Specific test
|
||||||
|
pytest tests/test_brain.py::test_parse_valid_json -v
|
||||||
|
|
||||||
|
# With coverage
|
||||||
|
pytest -v --cov=src --cov-report=term-missing
|
||||||
|
|
||||||
|
# Stop on first failure
|
||||||
|
pytest -x
|
||||||
|
|
||||||
|
# Verbose output with print statements
|
||||||
|
pytest -v -s
|
||||||
|
```
|
||||||
|
|
||||||
|
## CI/CD Integration
|
||||||
|
|
||||||
|
Tests run automatically on:
|
||||||
|
- Every commit to feature branches
|
||||||
|
- Every PR to main
|
||||||
|
- Scheduled daily runs
|
||||||
|
|
||||||
|
**Blocking conditions:**
|
||||||
|
- Test failures → PR blocked
|
||||||
|
- Coverage < 80% → PR blocked (warning only for main.py)
|
||||||
|
|
||||||
|
**Non-blocking:**
|
||||||
|
- `mypy --strict` errors (type hints encouraged but not enforced)
|
||||||
|
- `ruff check` warnings (must be acknowledged)
|
||||||
75
docs/workflow.md
Normal file
75
docs/workflow.md
Normal file
@@ -0,0 +1,75 @@
|
|||||||
|
# Development Workflow
|
||||||
|
|
||||||
|
## Git Workflow Policy
|
||||||
|
|
||||||
|
**CRITICAL: All code changes MUST follow this workflow. Direct pushes to `main` are ABSOLUTELY PROHIBITED.**
|
||||||
|
|
||||||
|
1. **Create Gitea Issue First** — All features, bug fixes, and policy changes require a Gitea issue before any code is written
|
||||||
|
2. **Create Feature Branch** — Branch from `main` using format `feature/issue-{N}-{short-description}`
|
||||||
|
3. **Implement Changes** — Write code, tests, and documentation on the feature branch
|
||||||
|
4. **Create Pull Request** — Submit PR to `main` branch referencing the issue number
|
||||||
|
5. **Review & Merge** — After approval, merge via PR (squash or merge commit)
|
||||||
|
|
||||||
|
**Never commit directly to `main`.** This policy applies to all changes, no exceptions.
|
||||||
|
|
||||||
|
## Agent Workflow
|
||||||
|
|
||||||
|
**Modern AI development leverages specialized agents for concurrent, efficient task execution.**
|
||||||
|
|
||||||
|
### Parallel Execution Strategy
|
||||||
|
|
||||||
|
Use **git worktree** or **subagents** (via the Task tool) to handle multiple requirements simultaneously:
|
||||||
|
|
||||||
|
- Each task runs in independent context
|
||||||
|
- Parallel branches for concurrent features
|
||||||
|
- Isolated test environments prevent interference
|
||||||
|
- Faster iteration with distributed workload
|
||||||
|
|
||||||
|
### Specialized Agent Roles
|
||||||
|
|
||||||
|
Deploy task-specific agents as needed instead of handling everything in the main conversation:
|
||||||
|
|
||||||
|
- **Conversational Agent** (main) — Interface with user, coordinate other agents
|
||||||
|
- **Ticket Management Agent** — Create/update Gitea issues, track task status
|
||||||
|
- **Design Agent** — Architectural planning, RFC documents, API design
|
||||||
|
- **Code Writing Agent** — Implementation following specs
|
||||||
|
- **Testing Agent** — Write tests, verify coverage, run test suites
|
||||||
|
- **Documentation Agent** — Update docs, docstrings, CLAUDE.md, README
|
||||||
|
- **Review Agent** — Code review, lint checks, security audits
|
||||||
|
- **Custom Agents** — Created dynamically for specialized tasks (performance analysis, migration scripts, etc.)
|
||||||
|
|
||||||
|
### When to Use Agents
|
||||||
|
|
||||||
|
**Prefer spawning specialized agents for:**
|
||||||
|
|
||||||
|
1. Complex multi-file changes requiring exploration
|
||||||
|
2. Tasks with clear, isolated scope (e.g., "write tests for module X")
|
||||||
|
3. Parallel work streams (feature A + bugfix B simultaneously)
|
||||||
|
4. Long-running analysis (codebase search, dependency audit)
|
||||||
|
5. Tasks requiring different contexts (multiple git worktrees)
|
||||||
|
|
||||||
|
**Use the main conversation for:**
|
||||||
|
|
||||||
|
1. User interaction and clarification
|
||||||
|
2. Quick single-file edits
|
||||||
|
3. Coordinating agent work
|
||||||
|
4. High-level decision making
|
||||||
|
|
||||||
|
### Implementation
|
||||||
|
|
||||||
|
```python
|
||||||
|
# Example: Spawn parallel test and documentation agents
|
||||||
|
task_tool(
|
||||||
|
subagent_type="general-purpose",
|
||||||
|
prompt="Write comprehensive tests for src/markets/schedule.py",
|
||||||
|
description="Write schedule tests"
|
||||||
|
)
|
||||||
|
|
||||||
|
task_tool(
|
||||||
|
subagent_type="general-purpose",
|
||||||
|
prompt="Update README.md with global market feature documentation",
|
||||||
|
description="Update README"
|
||||||
|
)
|
||||||
|
```
|
||||||
|
|
||||||
|
Use `run_in_background=True` for independent tasks that don't block subsequent work.
|
||||||
@@ -49,15 +49,40 @@ class GeminiClient:
|
|||||||
The prompt instructs Gemini to return valid JSON with action,
|
The prompt instructs Gemini to return valid JSON with action,
|
||||||
confidence, and rationale fields.
|
confidence, and rationale fields.
|
||||||
"""
|
"""
|
||||||
|
market_name = market_data.get("market_name", "Korean stock market")
|
||||||
|
|
||||||
|
# Build market data section dynamically based on available fields
|
||||||
|
market_info_lines = [
|
||||||
|
f"Market: {market_name}",
|
||||||
|
f"Stock Code: {market_data['stock_code']}",
|
||||||
|
f"Current Price: {market_data['current_price']}",
|
||||||
|
]
|
||||||
|
|
||||||
|
# Add orderbook if available (domestic markets)
|
||||||
|
if "orderbook" in market_data:
|
||||||
|
market_info_lines.append(
|
||||||
|
f"Orderbook: {json.dumps(market_data['orderbook'], ensure_ascii=False)}"
|
||||||
|
)
|
||||||
|
|
||||||
|
# Add foreigner net if non-zero
|
||||||
|
if market_data.get("foreigner_net", 0) != 0:
|
||||||
|
market_info_lines.append(
|
||||||
|
f"Foreigner Net Buy/Sell: {market_data['foreigner_net']}"
|
||||||
|
)
|
||||||
|
|
||||||
|
market_info = "\n".join(market_info_lines)
|
||||||
|
|
||||||
|
json_format = (
|
||||||
|
'{"action": "BUY"|"SELL"|"HOLD", '
|
||||||
|
'"confidence": <int 0-100>, "rationale": "<string>"}'
|
||||||
|
)
|
||||||
return (
|
return (
|
||||||
"You are a professional Korean stock market trading analyst.\n"
|
f"You are a professional {market_name} trading analyst.\n"
|
||||||
"Analyze the following market data and decide whether to BUY, SELL, or HOLD.\n\n"
|
"Analyze the following market data and decide whether to "
|
||||||
f"Stock Code: {market_data['stock_code']}\n"
|
"BUY, SELL, or HOLD.\n\n"
|
||||||
f"Current Price: {market_data['current_price']}\n"
|
f"{market_info}\n\n"
|
||||||
f"Orderbook: {json.dumps(market_data['orderbook'], ensure_ascii=False)}\n"
|
|
||||||
f"Foreigner Net Buy/Sell: {market_data['foreigner_net']}\n\n"
|
|
||||||
"You MUST respond with ONLY valid JSON in the following format:\n"
|
"You MUST respond with ONLY valid JSON in the following format:\n"
|
||||||
'{"action": "BUY"|"SELL"|"HOLD", "confidence": <int 0-100>, "rationale": "<string>"}\n\n'
|
f"{json_format}\n\n"
|
||||||
"Rules:\n"
|
"Rules:\n"
|
||||||
"- action must be exactly one of: BUY, SELL, HOLD\n"
|
"- action must be exactly one of: BUY, SELL, HOLD\n"
|
||||||
"- confidence must be an integer from 0 to 100\n"
|
"- confidence must be an integer from 0 to 100\n"
|
||||||
|
|||||||
@@ -6,11 +6,8 @@ Handles token refresh, rate limiting (leaky bucket), and hash key generation.
|
|||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
import asyncio
|
import asyncio
|
||||||
import hashlib
|
|
||||||
import json
|
|
||||||
import logging
|
import logging
|
||||||
import ssl
|
import ssl
|
||||||
import time
|
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
import aiohttp
|
import aiohttp
|
||||||
@@ -168,7 +165,7 @@ class KISBroker:
|
|||||||
f"get_orderbook failed ({resp.status}): {text}"
|
f"get_orderbook failed ({resp.status}): {text}"
|
||||||
)
|
)
|
||||||
return await resp.json()
|
return await resp.json()
|
||||||
except (aiohttp.ClientError, asyncio.TimeoutError) as exc:
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
raise ConnectionError(f"Network error fetching orderbook: {exc}") from exc
|
raise ConnectionError(f"Network error fetching orderbook: {exc}") from exc
|
||||||
|
|
||||||
async def get_balance(self) -> dict[str, Any]:
|
async def get_balance(self) -> dict[str, Any]:
|
||||||
@@ -200,7 +197,7 @@ class KISBroker:
|
|||||||
f"get_balance failed ({resp.status}): {text}"
|
f"get_balance failed ({resp.status}): {text}"
|
||||||
)
|
)
|
||||||
return await resp.json()
|
return await resp.json()
|
||||||
except (aiohttp.ClientError, asyncio.TimeoutError) as exc:
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
raise ConnectionError(f"Network error fetching balance: {exc}") from exc
|
raise ConnectionError(f"Network error fetching balance: {exc}") from exc
|
||||||
|
|
||||||
async def send_order(
|
async def send_order(
|
||||||
@@ -253,5 +250,5 @@ class KISBroker:
|
|||||||
},
|
},
|
||||||
)
|
)
|
||||||
return data
|
return data
|
||||||
except (aiohttp.ClientError, asyncio.TimeoutError) as exc:
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
raise ConnectionError(f"Network error sending order: {exc}") from exc
|
raise ConnectionError(f"Network error sending order: {exc}") from exc
|
||||||
|
|||||||
200
src/broker/overseas.py
Normal file
200
src/broker/overseas.py
Normal file
@@ -0,0 +1,200 @@
|
|||||||
|
"""KIS Overseas Stock API client."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import logging
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
import aiohttp
|
||||||
|
|
||||||
|
from src.broker.kis_api import KISBroker
|
||||||
|
|
||||||
|
logger = logging.getLogger(__name__)
|
||||||
|
|
||||||
|
|
||||||
|
class OverseasBroker:
|
||||||
|
"""KIS Overseas Stock API wrapper that reuses KISBroker infrastructure."""
|
||||||
|
|
||||||
|
def __init__(self, kis_broker: KISBroker) -> None:
|
||||||
|
"""
|
||||||
|
Initialize overseas broker.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
kis_broker: Domestic KIS broker instance to reuse session/token/rate limiter
|
||||||
|
"""
|
||||||
|
self._broker = kis_broker
|
||||||
|
|
||||||
|
async def get_overseas_price(
|
||||||
|
self, exchange_code: str, stock_code: str
|
||||||
|
) -> dict[str, Any]:
|
||||||
|
"""
|
||||||
|
Fetch overseas stock price.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
exchange_code: Exchange code (e.g., "NASD", "NYSE", "TSE")
|
||||||
|
stock_code: Stock ticker symbol
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
API response with price data
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ConnectionError: On network or API errors
|
||||||
|
"""
|
||||||
|
await self._broker._rate_limiter.acquire()
|
||||||
|
session = self._broker._get_session()
|
||||||
|
|
||||||
|
headers = await self._broker._auth_headers("HHDFS00000300")
|
||||||
|
params = {
|
||||||
|
"AUTH": "",
|
||||||
|
"EXCD": exchange_code,
|
||||||
|
"SYMB": stock_code,
|
||||||
|
}
|
||||||
|
url = f"{self._broker._base_url}/uapi/overseas-price/v1/quotations/price"
|
||||||
|
|
||||||
|
try:
|
||||||
|
async with session.get(url, headers=headers, params=params) as resp:
|
||||||
|
if resp.status != 200:
|
||||||
|
text = await resp.text()
|
||||||
|
raise ConnectionError(
|
||||||
|
f"get_overseas_price failed ({resp.status}): {text}"
|
||||||
|
)
|
||||||
|
return await resp.json()
|
||||||
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
|
raise ConnectionError(
|
||||||
|
f"Network error fetching overseas price: {exc}"
|
||||||
|
) from exc
|
||||||
|
|
||||||
|
async def get_overseas_balance(self, exchange_code: str) -> dict[str, Any]:
|
||||||
|
"""
|
||||||
|
Fetch overseas account balance.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
exchange_code: Exchange code (e.g., "NASD", "NYSE")
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
API response with balance data
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ConnectionError: On network or API errors
|
||||||
|
"""
|
||||||
|
await self._broker._rate_limiter.acquire()
|
||||||
|
session = self._broker._get_session()
|
||||||
|
|
||||||
|
# Virtual trading TR_ID for overseas balance inquiry
|
||||||
|
headers = await self._broker._auth_headers("VTTS3012R")
|
||||||
|
params = {
|
||||||
|
"CANO": self._broker._account_no,
|
||||||
|
"ACNT_PRDT_CD": self._broker._product_cd,
|
||||||
|
"OVRS_EXCG_CD": exchange_code,
|
||||||
|
"TR_CRCY_CD": self._get_currency_code(exchange_code),
|
||||||
|
"CTX_AREA_FK200": "",
|
||||||
|
"CTX_AREA_NK200": "",
|
||||||
|
}
|
||||||
|
url = (
|
||||||
|
f"{self._broker._base_url}/uapi/overseas-stock/v1/trading/inquire-balance"
|
||||||
|
)
|
||||||
|
|
||||||
|
try:
|
||||||
|
async with session.get(url, headers=headers, params=params) as resp:
|
||||||
|
if resp.status != 200:
|
||||||
|
text = await resp.text()
|
||||||
|
raise ConnectionError(
|
||||||
|
f"get_overseas_balance failed ({resp.status}): {text}"
|
||||||
|
)
|
||||||
|
return await resp.json()
|
||||||
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
|
raise ConnectionError(
|
||||||
|
f"Network error fetching overseas balance: {exc}"
|
||||||
|
) from exc
|
||||||
|
|
||||||
|
async def send_overseas_order(
|
||||||
|
self,
|
||||||
|
exchange_code: str,
|
||||||
|
stock_code: str,
|
||||||
|
order_type: str, # "BUY" or "SELL"
|
||||||
|
quantity: int,
|
||||||
|
price: float = 0.0,
|
||||||
|
) -> dict[str, Any]:
|
||||||
|
"""
|
||||||
|
Submit overseas stock order.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
exchange_code: Exchange code (e.g., "NASD", "NYSE")
|
||||||
|
stock_code: Stock ticker symbol
|
||||||
|
order_type: "BUY" or "SELL"
|
||||||
|
quantity: Number of shares
|
||||||
|
price: Order price (0 for market order)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
API response with order result
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ConnectionError: On network or API errors
|
||||||
|
"""
|
||||||
|
await self._broker._rate_limiter.acquire()
|
||||||
|
session = self._broker._get_session()
|
||||||
|
|
||||||
|
# Virtual trading TR_IDs for overseas orders
|
||||||
|
tr_id = "VTTT1002U" if order_type == "BUY" else "VTTT1006U"
|
||||||
|
|
||||||
|
body = {
|
||||||
|
"CANO": self._broker._account_no,
|
||||||
|
"ACNT_PRDT_CD": self._broker._product_cd,
|
||||||
|
"OVRS_EXCG_CD": exchange_code,
|
||||||
|
"PDNO": stock_code,
|
||||||
|
"ORD_DVSN": "00" if price > 0 else "01", # 00=지정가, 01=시장가
|
||||||
|
"ORD_QTY": str(quantity),
|
||||||
|
"OVRS_ORD_UNPR": str(price) if price > 0 else "0",
|
||||||
|
"ORD_SVR_DVSN_CD": "0", # 0=해외주문
|
||||||
|
}
|
||||||
|
|
||||||
|
hash_key = await self._broker._get_hash_key(body)
|
||||||
|
headers = await self._broker._auth_headers(tr_id)
|
||||||
|
headers["hashkey"] = hash_key
|
||||||
|
|
||||||
|
url = f"{self._broker._base_url}/uapi/overseas-stock/v1/trading/order"
|
||||||
|
|
||||||
|
try:
|
||||||
|
async with session.post(url, headers=headers, json=body) as resp:
|
||||||
|
if resp.status != 200:
|
||||||
|
text = await resp.text()
|
||||||
|
raise ConnectionError(
|
||||||
|
f"send_overseas_order failed ({resp.status}): {text}"
|
||||||
|
)
|
||||||
|
data = await resp.json()
|
||||||
|
logger.info(
|
||||||
|
"Overseas order submitted",
|
||||||
|
extra={
|
||||||
|
"exchange": exchange_code,
|
||||||
|
"stock_code": stock_code,
|
||||||
|
"action": order_type,
|
||||||
|
},
|
||||||
|
)
|
||||||
|
return data
|
||||||
|
except (TimeoutError, aiohttp.ClientError) as exc:
|
||||||
|
raise ConnectionError(
|
||||||
|
f"Network error sending overseas order: {exc}"
|
||||||
|
) from exc
|
||||||
|
|
||||||
|
def _get_currency_code(self, exchange_code: str) -> str:
|
||||||
|
"""
|
||||||
|
Map exchange code to currency code.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
exchange_code: Exchange code
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Currency code (e.g., "USD", "JPY")
|
||||||
|
"""
|
||||||
|
currency_map = {
|
||||||
|
"NASD": "USD",
|
||||||
|
"NYSE": "USD",
|
||||||
|
"AMEX": "USD",
|
||||||
|
"TSE": "JPY",
|
||||||
|
"SEHK": "HKD",
|
||||||
|
"SHAA": "CNY",
|
||||||
|
"SZAA": "CNY",
|
||||||
|
"HNX": "VND",
|
||||||
|
"HSX": "VND",
|
||||||
|
}
|
||||||
|
return currency_map.get(exchange_code, "USD")
|
||||||
@@ -33,6 +33,9 @@ class Settings(BaseSettings):
|
|||||||
# Trading mode
|
# Trading mode
|
||||||
MODE: str = Field(default="paper", pattern="^(paper|live)$")
|
MODE: str = Field(default="paper", pattern="^(paper|live)$")
|
||||||
|
|
||||||
|
# Market selection (comma-separated market codes)
|
||||||
|
ENABLED_MARKETS: str = "KR"
|
||||||
|
|
||||||
model_config = {"env_file": ".env", "env_file_encoding": "utf-8"}
|
model_config = {"env_file": ".env", "env_file_encoding": "utf-8"}
|
||||||
|
|
||||||
@property
|
@property
|
||||||
@@ -42,3 +45,8 @@ class Settings(BaseSettings):
|
|||||||
@property
|
@property
|
||||||
def account_product_code(self) -> str:
|
def account_product_code(self) -> str:
|
||||||
return self.KIS_ACCOUNT_NO.split("-")[1]
|
return self.KIS_ACCOUNT_NO.split("-")[1]
|
||||||
|
|
||||||
|
@property
|
||||||
|
def enabled_market_list(self) -> list[str]:
|
||||||
|
"""Parse ENABLED_MARKETS into list of market codes."""
|
||||||
|
return [m.strip() for m in self.ENABLED_MARKETS.split(",") if m.strip()]
|
||||||
|
|||||||
10
src/context/__init__.py
Normal file
10
src/context/__init__.py
Normal file
@@ -0,0 +1,10 @@
|
|||||||
|
"""Multi-layered context management system for trading decisions.
|
||||||
|
|
||||||
|
The context tree implements Pillar 2: hierarchical memory management across
|
||||||
|
7 time horizons, from real-time quotes to generational wisdom.
|
||||||
|
"""
|
||||||
|
|
||||||
|
from src.context.layer import ContextLayer
|
||||||
|
from src.context.store import ContextStore
|
||||||
|
|
||||||
|
__all__ = ["ContextLayer", "ContextStore"]
|
||||||
250
src/context/aggregator.py
Normal file
250
src/context/aggregator.py
Normal file
@@ -0,0 +1,250 @@
|
|||||||
|
"""Context aggregation logic for rolling up data from lower to higher layers."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import sqlite3
|
||||||
|
from datetime import UTC, datetime
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from src.context.layer import ContextLayer
|
||||||
|
from src.context.store import ContextStore
|
||||||
|
|
||||||
|
|
||||||
|
class ContextAggregator:
|
||||||
|
"""Aggregates context data from lower (finer) to higher (coarser) layers."""
|
||||||
|
|
||||||
|
def __init__(self, conn: sqlite3.Connection) -> None:
|
||||||
|
"""Initialize the aggregator with a database connection."""
|
||||||
|
self.conn = conn
|
||||||
|
self.store = ContextStore(conn)
|
||||||
|
|
||||||
|
def aggregate_daily_from_trades(self, date: str | None = None) -> None:
|
||||||
|
"""Aggregate L6 (daily) context from trades table.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
date: Date in YYYY-MM-DD format. If None, uses today.
|
||||||
|
"""
|
||||||
|
if date is None:
|
||||||
|
date = datetime.now(UTC).date().isoformat()
|
||||||
|
|
||||||
|
# Calculate daily metrics from trades
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT
|
||||||
|
COUNT(*) as trade_count,
|
||||||
|
SUM(CASE WHEN action = 'BUY' THEN 1 ELSE 0 END) as buys,
|
||||||
|
SUM(CASE WHEN action = 'SELL' THEN 1 ELSE 0 END) as sells,
|
||||||
|
SUM(CASE WHEN action = 'HOLD' THEN 1 ELSE 0 END) as holds,
|
||||||
|
AVG(confidence) as avg_confidence,
|
||||||
|
SUM(pnl) as total_pnl,
|
||||||
|
COUNT(DISTINCT stock_code) as unique_stocks,
|
||||||
|
SUM(CASE WHEN pnl > 0 THEN 1 ELSE 0 END) as wins,
|
||||||
|
SUM(CASE WHEN pnl < 0 THEN 1 ELSE 0 END) as losses
|
||||||
|
FROM trades
|
||||||
|
WHERE DATE(timestamp) = ?
|
||||||
|
""",
|
||||||
|
(date,),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
|
||||||
|
if row and row[0] > 0: # At least one trade
|
||||||
|
trade_count, buys, sells, holds, avg_conf, total_pnl, stocks, wins, losses = row
|
||||||
|
|
||||||
|
# Store daily metrics in L6
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "trade_count", trade_count)
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "buys", buys)
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "sells", sells)
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "holds", holds)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L6_DAILY, date, "avg_confidence", round(avg_conf, 2)
|
||||||
|
)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L6_DAILY, date, "total_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "unique_stocks", stocks)
|
||||||
|
win_rate = round(wins / max(wins + losses, 1) * 100, 2)
|
||||||
|
self.store.set_context(ContextLayer.L6_DAILY, date, "win_rate", win_rate)
|
||||||
|
|
||||||
|
def aggregate_weekly_from_daily(self, week: str | None = None) -> None:
|
||||||
|
"""Aggregate L5 (weekly) context from L6 (daily).
|
||||||
|
|
||||||
|
Args:
|
||||||
|
week: Week in YYYY-Www format (ISO week). If None, uses current week.
|
||||||
|
"""
|
||||||
|
if week is None:
|
||||||
|
week = datetime.now(UTC).strftime("%Y-W%V")
|
||||||
|
|
||||||
|
# Get all daily contexts for this week
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT key, value FROM contexts
|
||||||
|
WHERE layer = ? AND timeframe LIKE ?
|
||||||
|
""",
|
||||||
|
(ContextLayer.L6_DAILY.value, f"{week[:4]}-%"), # All days in the year
|
||||||
|
)
|
||||||
|
|
||||||
|
# Group by key and collect all values
|
||||||
|
import json
|
||||||
|
from collections import defaultdict
|
||||||
|
|
||||||
|
daily_data: dict[str, list[Any]] = defaultdict(list)
|
||||||
|
for row in cursor.fetchall():
|
||||||
|
daily_data[row[0]].append(json.loads(row[1]))
|
||||||
|
|
||||||
|
if daily_data:
|
||||||
|
# Sum all PnL values
|
||||||
|
if "total_pnl" in daily_data:
|
||||||
|
total_pnl = sum(daily_data["total_pnl"])
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L5_WEEKLY, week, "weekly_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
|
||||||
|
# Average all confidence values
|
||||||
|
if "avg_confidence" in daily_data:
|
||||||
|
conf_values = daily_data["avg_confidence"]
|
||||||
|
avg_conf = sum(conf_values) / len(conf_values)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L5_WEEKLY, week, "avg_confidence", round(avg_conf, 2)
|
||||||
|
)
|
||||||
|
|
||||||
|
def aggregate_monthly_from_weekly(self, month: str | None = None) -> None:
|
||||||
|
"""Aggregate L4 (monthly) context from L5 (weekly).
|
||||||
|
|
||||||
|
Args:
|
||||||
|
month: Month in YYYY-MM format. If None, uses current month.
|
||||||
|
"""
|
||||||
|
if month is None:
|
||||||
|
month = datetime.now(UTC).strftime("%Y-%m")
|
||||||
|
|
||||||
|
# Get all weekly contexts for this month
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT key, value FROM contexts
|
||||||
|
WHERE layer = ? AND timeframe LIKE ?
|
||||||
|
""",
|
||||||
|
(ContextLayer.L5_WEEKLY.value, f"{month[:4]}-W%"),
|
||||||
|
)
|
||||||
|
|
||||||
|
# Group by key and collect all values
|
||||||
|
import json
|
||||||
|
from collections import defaultdict
|
||||||
|
|
||||||
|
weekly_data: dict[str, list[Any]] = defaultdict(list)
|
||||||
|
for row in cursor.fetchall():
|
||||||
|
weekly_data[row[0]].append(json.loads(row[1]))
|
||||||
|
|
||||||
|
if weekly_data:
|
||||||
|
# Sum all weekly PnL values
|
||||||
|
if "weekly_pnl" in weekly_data:
|
||||||
|
total_pnl = sum(weekly_data["weekly_pnl"])
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L4_MONTHLY, month, "monthly_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
|
||||||
|
def aggregate_quarterly_from_monthly(self, quarter: str | None = None) -> None:
|
||||||
|
"""Aggregate L3 (quarterly) context from L4 (monthly).
|
||||||
|
|
||||||
|
Args:
|
||||||
|
quarter: Quarter in YYYY-Qn format. If None, uses current quarter.
|
||||||
|
"""
|
||||||
|
if quarter is None:
|
||||||
|
from datetime import datetime
|
||||||
|
|
||||||
|
now = datetime.now(UTC)
|
||||||
|
q = (now.month - 1) // 3 + 1
|
||||||
|
quarter = f"{now.year}-Q{q}"
|
||||||
|
|
||||||
|
# Get all monthly contexts for this quarter
|
||||||
|
# Q1: 01-03, Q2: 04-06, Q3: 07-09, Q4: 10-12
|
||||||
|
q_num = int(quarter.split("-Q")[1])
|
||||||
|
months = [f"{quarter[:4]}-{m:02d}" for m in range((q_num - 1) * 3 + 1, q_num * 3 + 1)]
|
||||||
|
|
||||||
|
total_pnl = 0.0
|
||||||
|
for month in months:
|
||||||
|
monthly_pnl = self.store.get_context(
|
||||||
|
ContextLayer.L4_MONTHLY, month, "monthly_pnl"
|
||||||
|
)
|
||||||
|
if monthly_pnl is not None:
|
||||||
|
total_pnl += monthly_pnl
|
||||||
|
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L3_QUARTERLY, quarter, "quarterly_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
|
||||||
|
def aggregate_annual_from_quarterly(self, year: str | None = None) -> None:
|
||||||
|
"""Aggregate L2 (annual) context from L3 (quarterly).
|
||||||
|
|
||||||
|
Args:
|
||||||
|
year: Year in YYYY format. If None, uses current year.
|
||||||
|
"""
|
||||||
|
if year is None:
|
||||||
|
year = str(datetime.now(UTC).year)
|
||||||
|
|
||||||
|
# Get all quarterly contexts for this year
|
||||||
|
total_pnl = 0.0
|
||||||
|
for q in range(1, 5):
|
||||||
|
quarter = f"{year}-Q{q}"
|
||||||
|
quarterly_pnl = self.store.get_context(
|
||||||
|
ContextLayer.L3_QUARTERLY, quarter, "quarterly_pnl"
|
||||||
|
)
|
||||||
|
if quarterly_pnl is not None:
|
||||||
|
total_pnl += quarterly_pnl
|
||||||
|
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L2_ANNUAL, year, "annual_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
|
||||||
|
def aggregate_legacy_from_annual(self) -> None:
|
||||||
|
"""Aggregate L1 (legacy) context from all L2 (annual) data."""
|
||||||
|
# Get all annual PnL
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT timeframe, value FROM contexts
|
||||||
|
WHERE layer = ? AND key = ?
|
||||||
|
ORDER BY timeframe
|
||||||
|
""",
|
||||||
|
(ContextLayer.L2_ANNUAL.value, "annual_pnl"),
|
||||||
|
)
|
||||||
|
|
||||||
|
import json
|
||||||
|
|
||||||
|
annual_data = [(row[0], json.loads(row[1])) for row in cursor.fetchall()]
|
||||||
|
|
||||||
|
if annual_data:
|
||||||
|
total_pnl = sum(pnl for _, pnl in annual_data)
|
||||||
|
years_traded = len(annual_data)
|
||||||
|
avg_annual_pnl = total_pnl / years_traded
|
||||||
|
|
||||||
|
# Store in L1 (single "LEGACY" timeframe)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L1_LEGACY, "LEGACY", "total_pnl", round(total_pnl, 2)
|
||||||
|
)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L1_LEGACY, "LEGACY", "years_traded", years_traded
|
||||||
|
)
|
||||||
|
self.store.set_context(
|
||||||
|
ContextLayer.L1_LEGACY,
|
||||||
|
"LEGACY",
|
||||||
|
"avg_annual_pnl",
|
||||||
|
round(avg_annual_pnl, 2),
|
||||||
|
)
|
||||||
|
|
||||||
|
def run_all_aggregations(self) -> None:
|
||||||
|
"""Run all aggregations from L7 to L1 (bottom-up)."""
|
||||||
|
# L7 (trades) → L6 (daily)
|
||||||
|
self.aggregate_daily_from_trades()
|
||||||
|
|
||||||
|
# L6 (daily) → L5 (weekly)
|
||||||
|
self.aggregate_weekly_from_daily()
|
||||||
|
|
||||||
|
# L5 (weekly) → L4 (monthly)
|
||||||
|
self.aggregate_monthly_from_weekly()
|
||||||
|
|
||||||
|
# L4 (monthly) → L3 (quarterly)
|
||||||
|
self.aggregate_quarterly_from_monthly()
|
||||||
|
|
||||||
|
# L3 (quarterly) → L2 (annual)
|
||||||
|
self.aggregate_annual_from_quarterly()
|
||||||
|
|
||||||
|
# L2 (annual) → L1 (legacy)
|
||||||
|
self.aggregate_legacy_from_annual()
|
||||||
75
src/context/layer.py
Normal file
75
src/context/layer.py
Normal file
@@ -0,0 +1,75 @@
|
|||||||
|
"""Context layer definitions for multi-tier memory management."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
from dataclasses import dataclass
|
||||||
|
from enum import Enum
|
||||||
|
|
||||||
|
|
||||||
|
class ContextLayer(str, Enum):
|
||||||
|
"""7-tier context hierarchy from real-time to generational."""
|
||||||
|
|
||||||
|
L1_LEGACY = "L1_LEGACY" # Cumulative/generational wisdom
|
||||||
|
L2_ANNUAL = "L2_ANNUAL" # Yearly performance
|
||||||
|
L3_QUARTERLY = "L3_QUARTERLY" # Quarterly strategy adjustments
|
||||||
|
L4_MONTHLY = "L4_MONTHLY" # Monthly rebalancing
|
||||||
|
L5_WEEKLY = "L5_WEEKLY" # Weekly stock selection
|
||||||
|
L6_DAILY = "L6_DAILY" # Daily trade logs
|
||||||
|
L7_REALTIME = "L7_REALTIME" # Real-time market data
|
||||||
|
|
||||||
|
|
||||||
|
@dataclass(frozen=True)
|
||||||
|
class LayerMetadata:
|
||||||
|
"""Metadata for each context layer."""
|
||||||
|
|
||||||
|
layer: ContextLayer
|
||||||
|
description: str
|
||||||
|
retention_days: int | None # None = keep forever
|
||||||
|
aggregation_source: ContextLayer | None # Parent layer for aggregation
|
||||||
|
|
||||||
|
|
||||||
|
# Layer configuration
|
||||||
|
LAYER_CONFIG: dict[ContextLayer, LayerMetadata] = {
|
||||||
|
ContextLayer.L1_LEGACY: LayerMetadata(
|
||||||
|
layer=ContextLayer.L1_LEGACY,
|
||||||
|
description="Cumulative trading history and core lessons learned across generations",
|
||||||
|
retention_days=None, # Keep forever
|
||||||
|
aggregation_source=ContextLayer.L2_ANNUAL,
|
||||||
|
),
|
||||||
|
ContextLayer.L2_ANNUAL: LayerMetadata(
|
||||||
|
layer=ContextLayer.L2_ANNUAL,
|
||||||
|
description="Yearly returns, Sharpe ratio, max drawdown, win rate",
|
||||||
|
retention_days=365 * 10, # 10 years
|
||||||
|
aggregation_source=ContextLayer.L3_QUARTERLY,
|
||||||
|
),
|
||||||
|
ContextLayer.L3_QUARTERLY: LayerMetadata(
|
||||||
|
layer=ContextLayer.L3_QUARTERLY,
|
||||||
|
description="Quarterly strategy adjustments, market phase detection, sector rotation",
|
||||||
|
retention_days=365 * 3, # 3 years
|
||||||
|
aggregation_source=ContextLayer.L4_MONTHLY,
|
||||||
|
),
|
||||||
|
ContextLayer.L4_MONTHLY: LayerMetadata(
|
||||||
|
layer=ContextLayer.L4_MONTHLY,
|
||||||
|
description="Monthly portfolio rebalancing, risk exposure, drawdown recovery",
|
||||||
|
retention_days=365 * 2, # 2 years
|
||||||
|
aggregation_source=ContextLayer.L5_WEEKLY,
|
||||||
|
),
|
||||||
|
ContextLayer.L5_WEEKLY: LayerMetadata(
|
||||||
|
layer=ContextLayer.L5_WEEKLY,
|
||||||
|
description="Weekly stock selection, sector focus, volatility regime",
|
||||||
|
retention_days=365, # 1 year
|
||||||
|
aggregation_source=ContextLayer.L6_DAILY,
|
||||||
|
),
|
||||||
|
ContextLayer.L6_DAILY: LayerMetadata(
|
||||||
|
layer=ContextLayer.L6_DAILY,
|
||||||
|
description="Daily trade logs, P&L, market summaries, decision accuracy",
|
||||||
|
retention_days=90, # 90 days
|
||||||
|
aggregation_source=ContextLayer.L7_REALTIME,
|
||||||
|
),
|
||||||
|
ContextLayer.L7_REALTIME: LayerMetadata(
|
||||||
|
layer=ContextLayer.L7_REALTIME,
|
||||||
|
description="Real-time positions, quotes, orderbook, volatility, live P&L",
|
||||||
|
retention_days=7, # 7 days (real-time data is ephemeral)
|
||||||
|
aggregation_source=None, # No aggregation source (leaf layer)
|
||||||
|
),
|
||||||
|
}
|
||||||
193
src/context/store.py
Normal file
193
src/context/store.py
Normal file
@@ -0,0 +1,193 @@
|
|||||||
|
"""Context storage and retrieval for the 7-tier memory system."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import json
|
||||||
|
import sqlite3
|
||||||
|
from datetime import UTC, datetime
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from src.context.layer import LAYER_CONFIG, ContextLayer
|
||||||
|
|
||||||
|
|
||||||
|
class ContextStore:
|
||||||
|
"""Manages context data across the 7-tier hierarchy."""
|
||||||
|
|
||||||
|
def __init__(self, conn: sqlite3.Connection) -> None:
|
||||||
|
"""Initialize the context store with a database connection."""
|
||||||
|
self.conn = conn
|
||||||
|
self._init_metadata()
|
||||||
|
|
||||||
|
def _init_metadata(self) -> None:
|
||||||
|
"""Initialize context_metadata table with layer configurations."""
|
||||||
|
for config in LAYER_CONFIG.values():
|
||||||
|
self.conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT OR REPLACE INTO context_metadata
|
||||||
|
(layer, description, retention_days, aggregation_source)
|
||||||
|
VALUES (?, ?, ?, ?)
|
||||||
|
""",
|
||||||
|
(
|
||||||
|
config.layer.value,
|
||||||
|
config.description,
|
||||||
|
config.retention_days,
|
||||||
|
config.aggregation_source.value if config.aggregation_source else None,
|
||||||
|
),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
|
||||||
|
def set_context(
|
||||||
|
self,
|
||||||
|
layer: ContextLayer,
|
||||||
|
timeframe: str,
|
||||||
|
key: str,
|
||||||
|
value: Any,
|
||||||
|
) -> None:
|
||||||
|
"""Set a context value for a given layer and timeframe.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
layer: The context layer (L1-L7)
|
||||||
|
timeframe: Time identifier (e.g., "2026", "2026-Q1", "2026-01",
|
||||||
|
"2026-W05", "2026-02-04")
|
||||||
|
key: Context key (e.g., "sharpe_ratio", "win_rate", "lesson_learned")
|
||||||
|
value: Context value (will be JSON-serialized)
|
||||||
|
"""
|
||||||
|
now = datetime.now(UTC).isoformat()
|
||||||
|
value_json = json.dumps(value)
|
||||||
|
|
||||||
|
self.conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT INTO contexts (layer, timeframe, key, value, created_at, updated_at)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?)
|
||||||
|
ON CONFLICT(layer, timeframe, key)
|
||||||
|
DO UPDATE SET value = excluded.value, updated_at = excluded.updated_at
|
||||||
|
""",
|
||||||
|
(layer.value, timeframe, key, value_json, now, now),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
|
||||||
|
def get_context(
|
||||||
|
self,
|
||||||
|
layer: ContextLayer,
|
||||||
|
timeframe: str,
|
||||||
|
key: str,
|
||||||
|
) -> Any | None:
|
||||||
|
"""Get a context value for a given layer and timeframe.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
layer: The context layer (L1-L7)
|
||||||
|
timeframe: Time identifier
|
||||||
|
key: Context key
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
The context value (deserialized from JSON), or None if not found
|
||||||
|
"""
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT value FROM contexts
|
||||||
|
WHERE layer = ? AND timeframe = ? AND key = ?
|
||||||
|
""",
|
||||||
|
(layer.value, timeframe, key),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
if row:
|
||||||
|
return json.loads(row[0])
|
||||||
|
return None
|
||||||
|
|
||||||
|
def get_all_contexts(
|
||||||
|
self,
|
||||||
|
layer: ContextLayer,
|
||||||
|
timeframe: str | None = None,
|
||||||
|
) -> dict[str, Any]:
|
||||||
|
"""Get all context values for a given layer and optional timeframe.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
layer: The context layer (L1-L7)
|
||||||
|
timeframe: Optional time identifier filter
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Dictionary of key-value pairs for the specified layer/timeframe
|
||||||
|
"""
|
||||||
|
if timeframe:
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT key, value FROM contexts
|
||||||
|
WHERE layer = ? AND timeframe = ?
|
||||||
|
ORDER BY key
|
||||||
|
""",
|
||||||
|
(layer.value, timeframe),
|
||||||
|
)
|
||||||
|
else:
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT key, value FROM contexts
|
||||||
|
WHERE layer = ?
|
||||||
|
ORDER BY timeframe DESC, key
|
||||||
|
""",
|
||||||
|
(layer.value,),
|
||||||
|
)
|
||||||
|
|
||||||
|
return {row[0]: json.loads(row[1]) for row in cursor.fetchall()}
|
||||||
|
|
||||||
|
def get_latest_timeframe(self, layer: ContextLayer) -> str | None:
|
||||||
|
"""Get the most recent timeframe for a given layer.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
layer: The context layer (L1-L7)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
The latest timeframe string, or None if no data exists
|
||||||
|
"""
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT timeframe FROM contexts
|
||||||
|
WHERE layer = ?
|
||||||
|
ORDER BY updated_at DESC
|
||||||
|
LIMIT 1
|
||||||
|
""",
|
||||||
|
(layer.value,),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
return row[0] if row else None
|
||||||
|
|
||||||
|
def delete_old_contexts(self, layer: ContextLayer, cutoff_date: str) -> int:
|
||||||
|
"""Delete contexts older than the cutoff date for a given layer.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
layer: The context layer (L1-L7)
|
||||||
|
cutoff_date: ISO format date string (contexts before this will be deleted)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Number of rows deleted
|
||||||
|
"""
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
DELETE FROM contexts
|
||||||
|
WHERE layer = ? AND updated_at < ?
|
||||||
|
""",
|
||||||
|
(layer.value, cutoff_date),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
return cursor.rowcount
|
||||||
|
|
||||||
|
def cleanup_expired_contexts(self) -> dict[ContextLayer, int]:
|
||||||
|
"""Delete expired contexts based on retention policies.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Dictionary mapping layer to number of deleted rows
|
||||||
|
"""
|
||||||
|
deleted_counts: dict[ContextLayer, int] = {}
|
||||||
|
|
||||||
|
for layer, config in LAYER_CONFIG.items():
|
||||||
|
if config.retention_days is None:
|
||||||
|
# Keep forever (e.g., L1_LEGACY)
|
||||||
|
deleted_counts[layer] = 0
|
||||||
|
continue
|
||||||
|
|
||||||
|
# Calculate cutoff date
|
||||||
|
from datetime import timedelta
|
||||||
|
|
||||||
|
cutoff = datetime.now(UTC) - timedelta(days=config.retention_days)
|
||||||
|
deleted_counts[layer] = self.delete_old_contexts(layer, cutoff.isoformat())
|
||||||
|
|
||||||
|
return deleted_counts
|
||||||
@@ -7,7 +7,6 @@ Changes require human approval and two passing test suites.
|
|||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
import logging
|
import logging
|
||||||
from dataclasses import dataclass
|
|
||||||
|
|
||||||
from src.config import Settings
|
from src.config import Settings
|
||||||
|
|
||||||
|
|||||||
94
src/db.py
94
src/db.py
@@ -3,9 +3,8 @@
|
|||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
import sqlite3
|
import sqlite3
|
||||||
from datetime import datetime, timezone
|
from datetime import UTC, datetime
|
||||||
from pathlib import Path
|
from pathlib import Path
|
||||||
from typing import Any
|
|
||||||
|
|
||||||
|
|
||||||
def init_db(db_path: str) -> sqlite3.Connection:
|
def init_db(db_path: str) -> sqlite3.Connection:
|
||||||
@@ -24,10 +23,86 @@ def init_db(db_path: str) -> sqlite3.Connection:
|
|||||||
rationale TEXT,
|
rationale TEXT,
|
||||||
quantity INTEGER,
|
quantity INTEGER,
|
||||||
price REAL,
|
price REAL,
|
||||||
pnl REAL DEFAULT 0.0
|
pnl REAL DEFAULT 0.0,
|
||||||
|
market TEXT DEFAULT 'KR',
|
||||||
|
exchange_code TEXT DEFAULT 'KRX'
|
||||||
)
|
)
|
||||||
"""
|
"""
|
||||||
)
|
)
|
||||||
|
|
||||||
|
# Migration: Add market and exchange_code columns if they don't exist
|
||||||
|
cursor = conn.execute("PRAGMA table_info(trades)")
|
||||||
|
columns = {row[1] for row in cursor.fetchall()}
|
||||||
|
|
||||||
|
if "market" not in columns:
|
||||||
|
conn.execute("ALTER TABLE trades ADD COLUMN market TEXT DEFAULT 'KR'")
|
||||||
|
if "exchange_code" not in columns:
|
||||||
|
conn.execute("ALTER TABLE trades ADD COLUMN exchange_code TEXT DEFAULT 'KRX'")
|
||||||
|
|
||||||
|
# Context tree tables for multi-layered memory management
|
||||||
|
conn.execute(
|
||||||
|
"""
|
||||||
|
CREATE TABLE IF NOT EXISTS contexts (
|
||||||
|
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||||
|
layer TEXT NOT NULL,
|
||||||
|
timeframe TEXT NOT NULL,
|
||||||
|
key TEXT NOT NULL,
|
||||||
|
value TEXT NOT NULL,
|
||||||
|
created_at TEXT NOT NULL,
|
||||||
|
updated_at TEXT NOT NULL,
|
||||||
|
UNIQUE(layer, timeframe, key)
|
||||||
|
)
|
||||||
|
"""
|
||||||
|
)
|
||||||
|
|
||||||
|
# Decision logging table for comprehensive audit trail
|
||||||
|
conn.execute(
|
||||||
|
"""
|
||||||
|
CREATE TABLE IF NOT EXISTS decision_logs (
|
||||||
|
decision_id TEXT PRIMARY KEY,
|
||||||
|
timestamp TEXT NOT NULL,
|
||||||
|
stock_code TEXT NOT NULL,
|
||||||
|
market TEXT NOT NULL,
|
||||||
|
exchange_code TEXT NOT NULL,
|
||||||
|
action TEXT NOT NULL,
|
||||||
|
confidence INTEGER NOT NULL,
|
||||||
|
rationale TEXT NOT NULL,
|
||||||
|
context_snapshot TEXT NOT NULL,
|
||||||
|
input_data TEXT NOT NULL,
|
||||||
|
outcome_pnl REAL,
|
||||||
|
outcome_accuracy INTEGER,
|
||||||
|
reviewed INTEGER DEFAULT 0,
|
||||||
|
review_notes TEXT
|
||||||
|
)
|
||||||
|
"""
|
||||||
|
)
|
||||||
|
|
||||||
|
conn.execute(
|
||||||
|
"""
|
||||||
|
CREATE TABLE IF NOT EXISTS context_metadata (
|
||||||
|
layer TEXT PRIMARY KEY,
|
||||||
|
description TEXT NOT NULL,
|
||||||
|
retention_days INTEGER,
|
||||||
|
aggregation_source TEXT
|
||||||
|
)
|
||||||
|
"""
|
||||||
|
)
|
||||||
|
|
||||||
|
# Create indices for efficient context queries
|
||||||
|
conn.execute("CREATE INDEX IF NOT EXISTS idx_contexts_layer ON contexts(layer)")
|
||||||
|
conn.execute("CREATE INDEX IF NOT EXISTS idx_contexts_timeframe ON contexts(timeframe)")
|
||||||
|
conn.execute("CREATE INDEX IF NOT EXISTS idx_contexts_updated ON contexts(updated_at)")
|
||||||
|
|
||||||
|
# Create indices for efficient decision log queries
|
||||||
|
conn.execute(
|
||||||
|
"CREATE INDEX IF NOT EXISTS idx_decision_logs_timestamp ON decision_logs(timestamp)"
|
||||||
|
)
|
||||||
|
conn.execute(
|
||||||
|
"CREATE INDEX IF NOT EXISTS idx_decision_logs_reviewed ON decision_logs(reviewed)"
|
||||||
|
)
|
||||||
|
conn.execute(
|
||||||
|
"CREATE INDEX IF NOT EXISTS idx_decision_logs_confidence ON decision_logs(confidence)"
|
||||||
|
)
|
||||||
conn.commit()
|
conn.commit()
|
||||||
return conn
|
return conn
|
||||||
|
|
||||||
@@ -41,15 +116,20 @@ def log_trade(
|
|||||||
quantity: int = 0,
|
quantity: int = 0,
|
||||||
price: float = 0.0,
|
price: float = 0.0,
|
||||||
pnl: float = 0.0,
|
pnl: float = 0.0,
|
||||||
|
market: str = "KR",
|
||||||
|
exchange_code: str = "KRX",
|
||||||
) -> None:
|
) -> None:
|
||||||
"""Insert a trade record into the database."""
|
"""Insert a trade record into the database."""
|
||||||
conn.execute(
|
conn.execute(
|
||||||
"""
|
"""
|
||||||
INSERT INTO trades (timestamp, stock_code, action, confidence, rationale, quantity, price, pnl)
|
INSERT INTO trades (
|
||||||
VALUES (?, ?, ?, ?, ?, ?, ?, ?)
|
timestamp, stock_code, action, confidence, rationale,
|
||||||
|
quantity, price, pnl, market, exchange_code
|
||||||
|
)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
|
||||||
""",
|
""",
|
||||||
(
|
(
|
||||||
datetime.now(timezone.utc).isoformat(),
|
datetime.now(UTC).isoformat(),
|
||||||
stock_code,
|
stock_code,
|
||||||
action,
|
action,
|
||||||
confidence,
|
confidence,
|
||||||
@@ -57,6 +137,8 @@ def log_trade(
|
|||||||
quantity,
|
quantity,
|
||||||
price,
|
price,
|
||||||
pnl,
|
pnl,
|
||||||
|
market,
|
||||||
|
exchange_code,
|
||||||
),
|
),
|
||||||
)
|
)
|
||||||
conn.commit()
|
conn.commit()
|
||||||
|
|||||||
@@ -14,7 +14,7 @@ import logging
|
|||||||
import sqlite3
|
import sqlite3
|
||||||
import subprocess
|
import subprocess
|
||||||
import textwrap
|
import textwrap
|
||||||
from datetime import datetime, timezone
|
from datetime import UTC, datetime
|
||||||
from pathlib import Path
|
from pathlib import Path
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
@@ -136,7 +136,7 @@ class EvolutionOptimizer:
|
|||||||
body = "\n".join(lines[1:-1])
|
body = "\n".join(lines[1:-1])
|
||||||
|
|
||||||
# Create strategy file
|
# Create strategy file
|
||||||
timestamp = datetime.now(timezone.utc).strftime("%Y%m%d_%H%M%S")
|
timestamp = datetime.now(UTC).strftime("%Y%m%d_%H%M%S")
|
||||||
version = f"v{timestamp}"
|
version = f"v{timestamp}"
|
||||||
class_name = f"Strategy_{version}"
|
class_name = f"Strategy_{version}"
|
||||||
file_name = f"{version}_evolved.py"
|
file_name = f"{version}_evolved.py"
|
||||||
@@ -149,7 +149,7 @@ class EvolutionOptimizer:
|
|||||||
|
|
||||||
content = STRATEGY_TEMPLATE.format(
|
content = STRATEGY_TEMPLATE.format(
|
||||||
name=version,
|
name=version,
|
||||||
timestamp=datetime.now(timezone.utc).isoformat(),
|
timestamp=datetime.now(UTC).isoformat(),
|
||||||
rationale="Auto-evolved from failure analysis",
|
rationale="Auto-evolved from failure analysis",
|
||||||
class_name=class_name,
|
class_name=class_name,
|
||||||
body=indented_body.strip(),
|
body=indented_body.strip(),
|
||||||
|
|||||||
5
src/logging/__init__.py
Normal file
5
src/logging/__init__.py
Normal file
@@ -0,0 +1,5 @@
|
|||||||
|
"""Decision logging and audit trail for trade decisions."""
|
||||||
|
|
||||||
|
from src.logging.decision_logger import DecisionLog, DecisionLogger
|
||||||
|
|
||||||
|
__all__ = ["DecisionLog", "DecisionLogger"]
|
||||||
235
src/logging/decision_logger.py
Normal file
235
src/logging/decision_logger.py
Normal file
@@ -0,0 +1,235 @@
|
|||||||
|
"""Decision logging system with context snapshots for comprehensive audit trail."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import json
|
||||||
|
import sqlite3
|
||||||
|
import uuid
|
||||||
|
from dataclasses import dataclass
|
||||||
|
from datetime import UTC, datetime
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
|
@dataclass
|
||||||
|
class DecisionLog:
|
||||||
|
"""A logged trading decision with context and outcome."""
|
||||||
|
|
||||||
|
decision_id: str
|
||||||
|
timestamp: str
|
||||||
|
stock_code: str
|
||||||
|
market: str
|
||||||
|
exchange_code: str
|
||||||
|
action: str
|
||||||
|
confidence: int
|
||||||
|
rationale: str
|
||||||
|
context_snapshot: dict[str, Any]
|
||||||
|
input_data: dict[str, Any]
|
||||||
|
outcome_pnl: float | None = None
|
||||||
|
outcome_accuracy: int | None = None
|
||||||
|
reviewed: bool = False
|
||||||
|
review_notes: str | None = None
|
||||||
|
|
||||||
|
|
||||||
|
class DecisionLogger:
|
||||||
|
"""Logs trading decisions with full context for review and evolution."""
|
||||||
|
|
||||||
|
def __init__(self, conn: sqlite3.Connection) -> None:
|
||||||
|
"""Initialize the decision logger with a database connection."""
|
||||||
|
self.conn = conn
|
||||||
|
|
||||||
|
def log_decision(
|
||||||
|
self,
|
||||||
|
stock_code: str,
|
||||||
|
market: str,
|
||||||
|
exchange_code: str,
|
||||||
|
action: str,
|
||||||
|
confidence: int,
|
||||||
|
rationale: str,
|
||||||
|
context_snapshot: dict[str, Any],
|
||||||
|
input_data: dict[str, Any],
|
||||||
|
) -> str:
|
||||||
|
"""Log a trading decision with full context.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
stock_code: Stock symbol
|
||||||
|
market: Market code (e.g., "KR", "US_NASDAQ")
|
||||||
|
exchange_code: Exchange code (e.g., "KRX", "NASDAQ")
|
||||||
|
action: Trading action (BUY/SELL/HOLD)
|
||||||
|
confidence: Confidence level (0-100)
|
||||||
|
rationale: Reasoning for the decision
|
||||||
|
context_snapshot: L1-L7 context snapshot at decision time
|
||||||
|
input_data: Market data inputs (price, volume, orderbook, etc.)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
decision_id: Unique identifier for this decision
|
||||||
|
"""
|
||||||
|
decision_id = str(uuid.uuid4())
|
||||||
|
timestamp = datetime.now(UTC).isoformat()
|
||||||
|
|
||||||
|
self.conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT INTO decision_logs (
|
||||||
|
decision_id, timestamp, stock_code, market, exchange_code,
|
||||||
|
action, confidence, rationale, context_snapshot, input_data
|
||||||
|
)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
|
||||||
|
""",
|
||||||
|
(
|
||||||
|
decision_id,
|
||||||
|
timestamp,
|
||||||
|
stock_code,
|
||||||
|
market,
|
||||||
|
exchange_code,
|
||||||
|
action,
|
||||||
|
confidence,
|
||||||
|
rationale,
|
||||||
|
json.dumps(context_snapshot),
|
||||||
|
json.dumps(input_data),
|
||||||
|
),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
|
||||||
|
return decision_id
|
||||||
|
|
||||||
|
def get_unreviewed_decisions(
|
||||||
|
self, min_confidence: int = 80, limit: int | None = None
|
||||||
|
) -> list[DecisionLog]:
|
||||||
|
"""Get unreviewed decisions with high confidence.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
min_confidence: Minimum confidence threshold (default 80)
|
||||||
|
limit: Maximum number of results (None = unlimited)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
List of unreviewed DecisionLog objects
|
||||||
|
"""
|
||||||
|
query = """
|
||||||
|
SELECT
|
||||||
|
decision_id, timestamp, stock_code, market, exchange_code,
|
||||||
|
action, confidence, rationale, context_snapshot, input_data,
|
||||||
|
outcome_pnl, outcome_accuracy, reviewed, review_notes
|
||||||
|
FROM decision_logs
|
||||||
|
WHERE reviewed = 0 AND confidence >= ?
|
||||||
|
ORDER BY timestamp DESC
|
||||||
|
"""
|
||||||
|
if limit is not None:
|
||||||
|
query += f" LIMIT {limit}"
|
||||||
|
|
||||||
|
cursor = self.conn.execute(query, (min_confidence,))
|
||||||
|
return [self._row_to_decision_log(row) for row in cursor.fetchall()]
|
||||||
|
|
||||||
|
def mark_reviewed(self, decision_id: str, notes: str) -> None:
|
||||||
|
"""Mark a decision as reviewed with notes.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
decision_id: Decision identifier
|
||||||
|
notes: Review notes and insights
|
||||||
|
"""
|
||||||
|
self.conn.execute(
|
||||||
|
"""
|
||||||
|
UPDATE decision_logs
|
||||||
|
SET reviewed = 1, review_notes = ?
|
||||||
|
WHERE decision_id = ?
|
||||||
|
""",
|
||||||
|
(notes, decision_id),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
|
||||||
|
def update_outcome(
|
||||||
|
self, decision_id: str, pnl: float, accuracy: int
|
||||||
|
) -> None:
|
||||||
|
"""Update the outcome of a decision after trade execution.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
decision_id: Decision identifier
|
||||||
|
pnl: Actual profit/loss realized
|
||||||
|
accuracy: 1 if decision was correct, 0 if wrong
|
||||||
|
"""
|
||||||
|
self.conn.execute(
|
||||||
|
"""
|
||||||
|
UPDATE decision_logs
|
||||||
|
SET outcome_pnl = ?, outcome_accuracy = ?
|
||||||
|
WHERE decision_id = ?
|
||||||
|
""",
|
||||||
|
(pnl, accuracy, decision_id),
|
||||||
|
)
|
||||||
|
self.conn.commit()
|
||||||
|
|
||||||
|
def get_decision_by_id(self, decision_id: str) -> DecisionLog | None:
|
||||||
|
"""Get a specific decision by ID.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
decision_id: Decision identifier
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
DecisionLog object or None if not found
|
||||||
|
"""
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT
|
||||||
|
decision_id, timestamp, stock_code, market, exchange_code,
|
||||||
|
action, confidence, rationale, context_snapshot, input_data,
|
||||||
|
outcome_pnl, outcome_accuracy, reviewed, review_notes
|
||||||
|
FROM decision_logs
|
||||||
|
WHERE decision_id = ?
|
||||||
|
""",
|
||||||
|
(decision_id,),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
return self._row_to_decision_log(row) if row else None
|
||||||
|
|
||||||
|
def get_losing_decisions(
|
||||||
|
self, min_confidence: int = 80, min_loss: float = -100.0
|
||||||
|
) -> list[DecisionLog]:
|
||||||
|
"""Get high-confidence decisions that resulted in losses.
|
||||||
|
|
||||||
|
Useful for identifying patterns in failed predictions.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
min_confidence: Minimum confidence threshold (default 80)
|
||||||
|
min_loss: Minimum loss amount (default -100.0, i.e., loss >= 100)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
List of losing DecisionLog objects
|
||||||
|
"""
|
||||||
|
cursor = self.conn.execute(
|
||||||
|
"""
|
||||||
|
SELECT
|
||||||
|
decision_id, timestamp, stock_code, market, exchange_code,
|
||||||
|
action, confidence, rationale, context_snapshot, input_data,
|
||||||
|
outcome_pnl, outcome_accuracy, reviewed, review_notes
|
||||||
|
FROM decision_logs
|
||||||
|
WHERE confidence >= ?
|
||||||
|
AND outcome_pnl IS NOT NULL
|
||||||
|
AND outcome_pnl <= ?
|
||||||
|
ORDER BY outcome_pnl ASC
|
||||||
|
""",
|
||||||
|
(min_confidence, min_loss),
|
||||||
|
)
|
||||||
|
return [self._row_to_decision_log(row) for row in cursor.fetchall()]
|
||||||
|
|
||||||
|
def _row_to_decision_log(self, row: tuple[Any, ...]) -> DecisionLog:
|
||||||
|
"""Convert a database row to a DecisionLog object.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
row: Database row tuple
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
DecisionLog object
|
||||||
|
"""
|
||||||
|
return DecisionLog(
|
||||||
|
decision_id=row[0],
|
||||||
|
timestamp=row[1],
|
||||||
|
stock_code=row[2],
|
||||||
|
market=row[3],
|
||||||
|
exchange_code=row[4],
|
||||||
|
action=row[5],
|
||||||
|
confidence=row[6],
|
||||||
|
rationale=row[7],
|
||||||
|
context_snapshot=json.loads(row[8]),
|
||||||
|
input_data=json.loads(row[9]),
|
||||||
|
outcome_pnl=row[10],
|
||||||
|
outcome_accuracy=row[11],
|
||||||
|
reviewed=bool(row[12]),
|
||||||
|
review_notes=row[13],
|
||||||
|
)
|
||||||
@@ -2,20 +2,19 @@
|
|||||||
|
|
||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import json
|
||||||
import logging
|
import logging
|
||||||
import sys
|
import sys
|
||||||
from datetime import datetime, timezone
|
from datetime import UTC, datetime
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
import json
|
|
||||||
|
|
||||||
|
|
||||||
class JSONFormatter(logging.Formatter):
|
class JSONFormatter(logging.Formatter):
|
||||||
"""Emit log records as single-line JSON objects."""
|
"""Emit log records as single-line JSON objects."""
|
||||||
|
|
||||||
def format(self, record: logging.LogRecord) -> str:
|
def format(self, record: logging.LogRecord) -> str:
|
||||||
log_entry: dict[str, Any] = {
|
log_entry: dict[str, Any] = {
|
||||||
"timestamp": datetime.now(timezone.utc).isoformat(),
|
"timestamp": datetime.now(UTC).isoformat(),
|
||||||
"level": record.levelname,
|
"level": record.levelname,
|
||||||
"logger": record.name,
|
"logger": record.name,
|
||||||
"message": record.getMessage(),
|
"message": record.getMessage(),
|
||||||
|
|||||||
224
src/main.py
224
src/main.py
@@ -10,70 +10,132 @@ import argparse
|
|||||||
import asyncio
|
import asyncio
|
||||||
import logging
|
import logging
|
||||||
import signal
|
import signal
|
||||||
import sys
|
from datetime import UTC, datetime
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
from src.brain.gemini_client import GeminiClient
|
from src.brain.gemini_client import GeminiClient
|
||||||
from src.broker.kis_api import KISBroker
|
from src.broker.kis_api import KISBroker
|
||||||
|
from src.broker.overseas import OverseasBroker
|
||||||
from src.config import Settings
|
from src.config import Settings
|
||||||
from src.core.risk_manager import CircuitBreakerTripped, RiskManager
|
from src.core.risk_manager import CircuitBreakerTripped, RiskManager
|
||||||
from src.db import init_db, log_trade
|
from src.db import init_db, log_trade
|
||||||
|
from src.logging.decision_logger import DecisionLogger
|
||||||
from src.logging_config import setup_logging
|
from src.logging_config import setup_logging
|
||||||
|
from src.markets.schedule import MarketInfo, get_next_market_open, get_open_markets
|
||||||
|
|
||||||
logger = logging.getLogger(__name__)
|
logger = logging.getLogger(__name__)
|
||||||
|
|
||||||
# Target stock codes to monitor
|
# Target stock codes to monitor per market
|
||||||
WATCHLIST = ["005930", "000660", "035420"] # Samsung, SK Hynix, NAVER
|
WATCHLISTS = {
|
||||||
|
"KR": ["005930", "000660", "035420"], # Samsung, SK Hynix, NAVER
|
||||||
|
"US_NASDAQ": ["AAPL", "MSFT", "GOOGL"], # Example US stocks
|
||||||
|
"US_NYSE": ["JPM", "BAC"], # Example NYSE stocks
|
||||||
|
"JP": ["7203", "6758"], # Toyota, Sony
|
||||||
|
}
|
||||||
|
|
||||||
TRADE_INTERVAL_SECONDS = 60
|
TRADE_INTERVAL_SECONDS = 60
|
||||||
|
MAX_CONNECTION_RETRIES = 3
|
||||||
|
|
||||||
|
|
||||||
async def trading_cycle(
|
async def trading_cycle(
|
||||||
broker: KISBroker,
|
broker: KISBroker,
|
||||||
|
overseas_broker: OverseasBroker,
|
||||||
brain: GeminiClient,
|
brain: GeminiClient,
|
||||||
risk: RiskManager,
|
risk: RiskManager,
|
||||||
db_conn: Any,
|
db_conn: Any,
|
||||||
|
decision_logger: DecisionLogger,
|
||||||
|
market: MarketInfo,
|
||||||
stock_code: str,
|
stock_code: str,
|
||||||
) -> None:
|
) -> None:
|
||||||
"""Execute one trading cycle for a single stock."""
|
"""Execute one trading cycle for a single stock."""
|
||||||
# 1. Fetch market data
|
# 1. Fetch market data
|
||||||
orderbook = await broker.get_orderbook(stock_code)
|
if market.is_domestic:
|
||||||
balance_data = await broker.get_balance()
|
orderbook = await broker.get_orderbook(stock_code)
|
||||||
|
balance_data = await broker.get_balance()
|
||||||
|
|
||||||
output2 = balance_data.get("output2", [{}])
|
output2 = balance_data.get("output2", [{}])
|
||||||
total_eval = float(output2[0].get("tot_evlu_amt", "0")) if output2 else 0
|
total_eval = float(output2[0].get("tot_evlu_amt", "0")) if output2 else 0
|
||||||
total_cash = float(
|
total_cash = float(
|
||||||
balance_data.get("output2", [{}])[0].get("dnca_tot_amt", "0")
|
balance_data.get("output2", [{}])[0].get("dnca_tot_amt", "0")
|
||||||
if output2
|
if output2
|
||||||
else "0"
|
else "0"
|
||||||
)
|
)
|
||||||
purchase_total = float(output2[0].get("pchs_amt_smtl_amt", "0")) if output2 else 0
|
purchase_total = float(output2[0].get("pchs_amt_smtl_amt", "0")) if output2 else 0
|
||||||
|
|
||||||
|
current_price = float(orderbook.get("output1", {}).get("stck_prpr", "0"))
|
||||||
|
foreigner_net = float(orderbook.get("output1", {}).get("frgn_ntby_qty", "0"))
|
||||||
|
else:
|
||||||
|
# Overseas market
|
||||||
|
price_data = await overseas_broker.get_overseas_price(
|
||||||
|
market.exchange_code, stock_code
|
||||||
|
)
|
||||||
|
balance_data = await overseas_broker.get_overseas_balance(market.exchange_code)
|
||||||
|
|
||||||
|
output2 = balance_data.get("output2", [{}])
|
||||||
|
total_eval = float(output2[0].get("frcr_evlu_tota", "0")) if output2 else 0
|
||||||
|
total_cash = float(output2[0].get("frcr_dncl_amt_2", "0")) if output2 else 0
|
||||||
|
purchase_total = float(output2[0].get("frcr_buy_amt_smtl", "0")) if output2 else 0
|
||||||
|
|
||||||
|
current_price = float(price_data.get("output", {}).get("last", "0"))
|
||||||
|
foreigner_net = 0.0 # Not available for overseas
|
||||||
|
|
||||||
# Calculate daily P&L %
|
# Calculate daily P&L %
|
||||||
pnl_pct = ((total_eval - purchase_total) / purchase_total * 100) if purchase_total > 0 else 0.0
|
pnl_pct = (
|
||||||
|
((total_eval - purchase_total) / purchase_total * 100)
|
||||||
current_price = float(
|
if purchase_total > 0
|
||||||
orderbook.get("output1", {}).get("stck_prpr", "0")
|
else 0.0
|
||||||
)
|
)
|
||||||
|
|
||||||
market_data = {
|
market_data = {
|
||||||
"stock_code": stock_code,
|
"stock_code": stock_code,
|
||||||
|
"market_name": market.name,
|
||||||
"current_price": current_price,
|
"current_price": current_price,
|
||||||
"orderbook": orderbook.get("output1", {}),
|
"foreigner_net": foreigner_net,
|
||||||
"foreigner_net": float(
|
|
||||||
orderbook.get("output1", {}).get("frgn_ntby_qty", "0")
|
|
||||||
),
|
|
||||||
}
|
}
|
||||||
|
|
||||||
# 2. Ask the brain for a decision
|
# 2. Ask the brain for a decision
|
||||||
decision = await brain.decide(market_data)
|
decision = await brain.decide(market_data)
|
||||||
logger.info(
|
logger.info(
|
||||||
"Decision for %s: %s (confidence=%d)",
|
"Decision for %s (%s): %s (confidence=%d)",
|
||||||
stock_code,
|
stock_code,
|
||||||
|
market.name,
|
||||||
decision.action,
|
decision.action,
|
||||||
decision.confidence,
|
decision.confidence,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
# 2.5. Log decision with context snapshot
|
||||||
|
context_snapshot = {
|
||||||
|
"L1": {
|
||||||
|
"current_price": current_price,
|
||||||
|
"foreigner_net": foreigner_net,
|
||||||
|
},
|
||||||
|
"L2": {
|
||||||
|
"total_eval": total_eval,
|
||||||
|
"total_cash": total_cash,
|
||||||
|
"purchase_total": purchase_total,
|
||||||
|
"pnl_pct": pnl_pct,
|
||||||
|
},
|
||||||
|
# L3-L7 will be populated when context tree is implemented
|
||||||
|
}
|
||||||
|
input_data = {
|
||||||
|
"current_price": current_price,
|
||||||
|
"foreigner_net": foreigner_net,
|
||||||
|
"total_eval": total_eval,
|
||||||
|
"total_cash": total_cash,
|
||||||
|
"pnl_pct": pnl_pct,
|
||||||
|
}
|
||||||
|
|
||||||
|
decision_logger.log_decision(
|
||||||
|
stock_code=stock_code,
|
||||||
|
market=market.code,
|
||||||
|
exchange_code=market.exchange_code,
|
||||||
|
action=decision.action,
|
||||||
|
confidence=decision.confidence,
|
||||||
|
rationale=decision.rationale,
|
||||||
|
context_snapshot=context_snapshot,
|
||||||
|
input_data=input_data,
|
||||||
|
)
|
||||||
|
|
||||||
# 3. Execute if actionable
|
# 3. Execute if actionable
|
||||||
if decision.action in ("BUY", "SELL"):
|
if decision.action in ("BUY", "SELL"):
|
||||||
# Determine order size (simplified: 1 lot)
|
# Determine order size (simplified: 1 lot)
|
||||||
@@ -88,12 +150,21 @@ async def trading_cycle(
|
|||||||
)
|
)
|
||||||
|
|
||||||
# 5. Send order
|
# 5. Send order
|
||||||
result = await broker.send_order(
|
if market.is_domestic:
|
||||||
stock_code=stock_code,
|
result = await broker.send_order(
|
||||||
order_type=decision.action,
|
stock_code=stock_code,
|
||||||
quantity=quantity,
|
order_type=decision.action,
|
||||||
price=0, # market order
|
quantity=quantity,
|
||||||
)
|
price=0, # market order
|
||||||
|
)
|
||||||
|
else:
|
||||||
|
result = await overseas_broker.send_overseas_order(
|
||||||
|
exchange_code=market.exchange_code,
|
||||||
|
stock_code=stock_code,
|
||||||
|
order_type=decision.action,
|
||||||
|
quantity=quantity,
|
||||||
|
price=0.0, # market order
|
||||||
|
)
|
||||||
logger.info("Order result: %s", result.get("msg1", "OK"))
|
logger.info("Order result: %s", result.get("msg1", "OK"))
|
||||||
|
|
||||||
# 6. Log trade
|
# 6. Log trade
|
||||||
@@ -103,15 +174,19 @@ async def trading_cycle(
|
|||||||
action=decision.action,
|
action=decision.action,
|
||||||
confidence=decision.confidence,
|
confidence=decision.confidence,
|
||||||
rationale=decision.rationale,
|
rationale=decision.rationale,
|
||||||
|
market=market.code,
|
||||||
|
exchange_code=market.exchange_code,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|
||||||
async def run(settings: Settings) -> None:
|
async def run(settings: Settings) -> None:
|
||||||
"""Main async loop — iterate over watchlist on a timer."""
|
"""Main async loop — iterate over open markets on a timer."""
|
||||||
broker = KISBroker(settings)
|
broker = KISBroker(settings)
|
||||||
|
overseas_broker = OverseasBroker(broker)
|
||||||
brain = GeminiClient(settings)
|
brain = GeminiClient(settings)
|
||||||
risk = RiskManager(settings)
|
risk = RiskManager(settings)
|
||||||
db_conn = init_db(settings.DB_PATH)
|
db_conn = init_db(settings.DB_PATH)
|
||||||
|
decision_logger = DecisionLogger(db_conn)
|
||||||
|
|
||||||
shutdown = asyncio.Event()
|
shutdown = asyncio.Event()
|
||||||
|
|
||||||
@@ -124,27 +199,94 @@ async def run(settings: Settings) -> None:
|
|||||||
loop.add_signal_handler(sig, _signal_handler)
|
loop.add_signal_handler(sig, _signal_handler)
|
||||||
|
|
||||||
logger.info("The Ouroboros is alive. Mode: %s", settings.MODE)
|
logger.info("The Ouroboros is alive. Mode: %s", settings.MODE)
|
||||||
logger.info("Watchlist: %s", WATCHLIST)
|
logger.info("Enabled markets: %s", settings.enabled_market_list)
|
||||||
|
|
||||||
try:
|
try:
|
||||||
while not shutdown.is_set():
|
while not shutdown.is_set():
|
||||||
for code in WATCHLIST:
|
# Get currently open markets
|
||||||
|
open_markets = get_open_markets(settings.enabled_market_list)
|
||||||
|
|
||||||
|
if not open_markets:
|
||||||
|
# No markets open — wait until next market opens
|
||||||
|
try:
|
||||||
|
next_market, next_open_time = get_next_market_open(
|
||||||
|
settings.enabled_market_list
|
||||||
|
)
|
||||||
|
now = datetime.now(UTC)
|
||||||
|
wait_seconds = (next_open_time - now).total_seconds()
|
||||||
|
logger.info(
|
||||||
|
"No markets open. Next market: %s, opens in %.1f hours",
|
||||||
|
next_market.name,
|
||||||
|
wait_seconds / 3600,
|
||||||
|
)
|
||||||
|
await asyncio.wait_for(shutdown.wait(), timeout=wait_seconds)
|
||||||
|
except TimeoutError:
|
||||||
|
continue # Market should be open now
|
||||||
|
except ValueError as exc:
|
||||||
|
logger.error("Failed to find next market open: %s", exc)
|
||||||
|
await asyncio.sleep(TRADE_INTERVAL_SECONDS)
|
||||||
|
continue
|
||||||
|
|
||||||
|
# Process each open market
|
||||||
|
for market in open_markets:
|
||||||
if shutdown.is_set():
|
if shutdown.is_set():
|
||||||
break
|
break
|
||||||
try:
|
|
||||||
await trading_cycle(broker, brain, risk, db_conn, code)
|
# Get watchlist for this market
|
||||||
except CircuitBreakerTripped:
|
watchlist = WATCHLISTS.get(market.code, [])
|
||||||
logger.critical("Circuit breaker tripped — shutting down")
|
if not watchlist:
|
||||||
raise
|
logger.debug("No watchlist for market %s", market.code)
|
||||||
except ConnectionError as exc:
|
continue
|
||||||
logger.error("Connection error for %s: %s", code, exc)
|
|
||||||
except Exception as exc:
|
logger.info("Processing market: %s (%d stocks)", market.name, len(watchlist))
|
||||||
logger.exception("Unexpected error for %s: %s", code, exc)
|
|
||||||
|
# Process each stock in the watchlist
|
||||||
|
for stock_code in watchlist:
|
||||||
|
if shutdown.is_set():
|
||||||
|
break
|
||||||
|
|
||||||
|
# Retry logic for connection errors
|
||||||
|
for attempt in range(1, MAX_CONNECTION_RETRIES + 1):
|
||||||
|
try:
|
||||||
|
await trading_cycle(
|
||||||
|
broker,
|
||||||
|
overseas_broker,
|
||||||
|
brain,
|
||||||
|
risk,
|
||||||
|
db_conn,
|
||||||
|
decision_logger,
|
||||||
|
market,
|
||||||
|
stock_code,
|
||||||
|
)
|
||||||
|
break # Success — exit retry loop
|
||||||
|
except CircuitBreakerTripped:
|
||||||
|
logger.critical("Circuit breaker tripped — shutting down")
|
||||||
|
raise
|
||||||
|
except ConnectionError as exc:
|
||||||
|
if attempt < MAX_CONNECTION_RETRIES:
|
||||||
|
logger.warning(
|
||||||
|
"Connection error for %s (attempt %d/%d): %s",
|
||||||
|
stock_code,
|
||||||
|
attempt,
|
||||||
|
MAX_CONNECTION_RETRIES,
|
||||||
|
exc,
|
||||||
|
)
|
||||||
|
await asyncio.sleep(2**attempt) # Exponential backoff
|
||||||
|
else:
|
||||||
|
logger.error(
|
||||||
|
"Connection error for %s (all retries exhausted): %s",
|
||||||
|
stock_code,
|
||||||
|
exc,
|
||||||
|
)
|
||||||
|
break # Give up on this stock
|
||||||
|
except Exception as exc:
|
||||||
|
logger.exception("Unexpected error for %s: %s", stock_code, exc)
|
||||||
|
break # Don't retry on unexpected errors
|
||||||
|
|
||||||
# Wait for next cycle or shutdown
|
# Wait for next cycle or shutdown
|
||||||
try:
|
try:
|
||||||
await asyncio.wait_for(shutdown.wait(), timeout=TRADE_INTERVAL_SECONDS)
|
await asyncio.wait_for(shutdown.wait(), timeout=TRADE_INTERVAL_SECONDS)
|
||||||
except asyncio.TimeoutError:
|
except TimeoutError:
|
||||||
pass # Normal — timeout means it's time for next cycle
|
pass # Normal — timeout means it's time for next cycle
|
||||||
finally:
|
finally:
|
||||||
await broker.close()
|
await broker.close()
|
||||||
|
|||||||
1
src/markets/__init__.py
Normal file
1
src/markets/__init__.py
Normal file
@@ -0,0 +1 @@
|
|||||||
|
"""Global market scheduling and timezone management."""
|
||||||
252
src/markets/schedule.py
Normal file
252
src/markets/schedule.py
Normal file
@@ -0,0 +1,252 @@
|
|||||||
|
"""Market schedule management with timezone support."""
|
||||||
|
|
||||||
|
from dataclasses import dataclass
|
||||||
|
from datetime import datetime, time, timedelta
|
||||||
|
from zoneinfo import ZoneInfo
|
||||||
|
|
||||||
|
|
||||||
|
@dataclass(frozen=True)
|
||||||
|
class MarketInfo:
|
||||||
|
"""Information about a trading market."""
|
||||||
|
|
||||||
|
code: str # Market code for internal use (e.g., "KR", "US_NASDAQ")
|
||||||
|
exchange_code: str # KIS API exchange code (e.g., "NASD", "NYSE")
|
||||||
|
name: str # Human-readable name
|
||||||
|
timezone: ZoneInfo # Market timezone
|
||||||
|
open_time: time # Market open time in local timezone
|
||||||
|
close_time: time # Market close time in local timezone
|
||||||
|
is_domestic: bool # True for Korean market, False for overseas
|
||||||
|
lunch_break: tuple[time, time] | None = None # (start, end) or None
|
||||||
|
|
||||||
|
|
||||||
|
# 10 global markets with their schedules
|
||||||
|
MARKETS: dict[str, MarketInfo] = {
|
||||||
|
"KR": MarketInfo(
|
||||||
|
code="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
name="Korea Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Seoul"),
|
||||||
|
open_time=time(9, 0),
|
||||||
|
close_time=time(15, 30),
|
||||||
|
is_domestic=True,
|
||||||
|
lunch_break=None, # KRX removed lunch break
|
||||||
|
),
|
||||||
|
"US_NASDAQ": MarketInfo(
|
||||||
|
code="US_NASDAQ",
|
||||||
|
exchange_code="NASD",
|
||||||
|
name="NASDAQ",
|
||||||
|
timezone=ZoneInfo("America/New_York"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(16, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=None,
|
||||||
|
),
|
||||||
|
"US_NYSE": MarketInfo(
|
||||||
|
code="US_NYSE",
|
||||||
|
exchange_code="NYSE",
|
||||||
|
name="New York Stock Exchange",
|
||||||
|
timezone=ZoneInfo("America/New_York"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(16, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=None,
|
||||||
|
),
|
||||||
|
"US_AMEX": MarketInfo(
|
||||||
|
code="US_AMEX",
|
||||||
|
exchange_code="AMEX",
|
||||||
|
name="NYSE American",
|
||||||
|
timezone=ZoneInfo("America/New_York"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(16, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=None,
|
||||||
|
),
|
||||||
|
"JP": MarketInfo(
|
||||||
|
code="JP",
|
||||||
|
exchange_code="TSE",
|
||||||
|
name="Tokyo Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Tokyo"),
|
||||||
|
open_time=time(9, 0),
|
||||||
|
close_time=time(15, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(11, 30), time(12, 30)),
|
||||||
|
),
|
||||||
|
"HK": MarketInfo(
|
||||||
|
code="HK",
|
||||||
|
exchange_code="SEHK",
|
||||||
|
name="Hong Kong Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Hong_Kong"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(16, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(12, 0), time(13, 0)),
|
||||||
|
),
|
||||||
|
"CN_SHA": MarketInfo(
|
||||||
|
code="CN_SHA",
|
||||||
|
exchange_code="SHAA",
|
||||||
|
name="Shanghai Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Shanghai"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(15, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(11, 30), time(13, 0)),
|
||||||
|
),
|
||||||
|
"CN_SZA": MarketInfo(
|
||||||
|
code="CN_SZA",
|
||||||
|
exchange_code="SZAA",
|
||||||
|
name="Shenzhen Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Shanghai"),
|
||||||
|
open_time=time(9, 30),
|
||||||
|
close_time=time(15, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(11, 30), time(13, 0)),
|
||||||
|
),
|
||||||
|
"VN_HAN": MarketInfo(
|
||||||
|
code="VN_HAN",
|
||||||
|
exchange_code="HNX",
|
||||||
|
name="Hanoi Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Ho_Chi_Minh"),
|
||||||
|
open_time=time(9, 0),
|
||||||
|
close_time=time(15, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(11, 30), time(13, 0)),
|
||||||
|
),
|
||||||
|
"VN_HCM": MarketInfo(
|
||||||
|
code="VN_HCM",
|
||||||
|
exchange_code="HSX",
|
||||||
|
name="Ho Chi Minh Stock Exchange",
|
||||||
|
timezone=ZoneInfo("Asia/Ho_Chi_Minh"),
|
||||||
|
open_time=time(9, 0),
|
||||||
|
close_time=time(15, 0),
|
||||||
|
is_domestic=False,
|
||||||
|
lunch_break=(time(11, 30), time(13, 0)),
|
||||||
|
),
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def is_market_open(market: MarketInfo, now: datetime | None = None) -> bool:
|
||||||
|
"""
|
||||||
|
Check if a market is currently open for trading.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
market: Market information
|
||||||
|
now: Current time (defaults to datetime.now(UTC) for testing)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
True if market is open, False otherwise
|
||||||
|
|
||||||
|
Note:
|
||||||
|
Does not account for holidays (KIS API will reject orders on holidays)
|
||||||
|
"""
|
||||||
|
if now is None:
|
||||||
|
now = datetime.now(ZoneInfo("UTC"))
|
||||||
|
|
||||||
|
# Convert to market's local timezone
|
||||||
|
local_now = now.astimezone(market.timezone)
|
||||||
|
|
||||||
|
# Check if it's a weekend
|
||||||
|
if local_now.weekday() >= 5: # Saturday=5, Sunday=6
|
||||||
|
return False
|
||||||
|
|
||||||
|
current_time = local_now.time()
|
||||||
|
|
||||||
|
# Check if within trading hours
|
||||||
|
if current_time < market.open_time or current_time >= market.close_time:
|
||||||
|
return False
|
||||||
|
|
||||||
|
# Check lunch break
|
||||||
|
if market.lunch_break:
|
||||||
|
lunch_start, lunch_end = market.lunch_break
|
||||||
|
if lunch_start <= current_time < lunch_end:
|
||||||
|
return False
|
||||||
|
|
||||||
|
return True
|
||||||
|
|
||||||
|
|
||||||
|
def get_open_markets(
|
||||||
|
enabled_markets: list[str] | None = None, now: datetime | None = None
|
||||||
|
) -> list[MarketInfo]:
|
||||||
|
"""
|
||||||
|
Get list of currently open markets.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
enabled_markets: List of market codes to check (defaults to all markets)
|
||||||
|
now: Current time (defaults to datetime.now(UTC) for testing)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
List of open markets, sorted by market code
|
||||||
|
"""
|
||||||
|
if enabled_markets is None:
|
||||||
|
enabled_markets = list(MARKETS.keys())
|
||||||
|
|
||||||
|
open_markets = [
|
||||||
|
MARKETS[code]
|
||||||
|
for code in enabled_markets
|
||||||
|
if code in MARKETS and is_market_open(MARKETS[code], now)
|
||||||
|
]
|
||||||
|
|
||||||
|
return sorted(open_markets, key=lambda m: m.code)
|
||||||
|
|
||||||
|
|
||||||
|
def get_next_market_open(
|
||||||
|
enabled_markets: list[str] | None = None, now: datetime | None = None
|
||||||
|
) -> tuple[MarketInfo, datetime]:
|
||||||
|
"""
|
||||||
|
Find the next market that will open and when.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
enabled_markets: List of market codes to check (defaults to all markets)
|
||||||
|
now: Current time (defaults to datetime.now(UTC) for testing)
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Tuple of (market, open_datetime) for the next market to open
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ValueError: If no enabled markets are configured
|
||||||
|
"""
|
||||||
|
if now is None:
|
||||||
|
now = datetime.now(ZoneInfo("UTC"))
|
||||||
|
|
||||||
|
if enabled_markets is None:
|
||||||
|
enabled_markets = list(MARKETS.keys())
|
||||||
|
|
||||||
|
if not enabled_markets:
|
||||||
|
raise ValueError("No enabled markets configured")
|
||||||
|
|
||||||
|
next_open_time: datetime | None = None
|
||||||
|
next_market: MarketInfo | None = None
|
||||||
|
|
||||||
|
for code in enabled_markets:
|
||||||
|
if code not in MARKETS:
|
||||||
|
continue
|
||||||
|
|
||||||
|
market = MARKETS[code]
|
||||||
|
market_now = now.astimezone(market.timezone)
|
||||||
|
|
||||||
|
# Calculate next open time for this market
|
||||||
|
for days_ahead in range(7): # Check next 7 days
|
||||||
|
check_date = market_now.date() + timedelta(days=days_ahead)
|
||||||
|
check_datetime = datetime.combine(
|
||||||
|
check_date, market.open_time, tzinfo=market.timezone
|
||||||
|
)
|
||||||
|
|
||||||
|
# Skip weekends
|
||||||
|
if check_datetime.weekday() >= 5:
|
||||||
|
continue
|
||||||
|
|
||||||
|
# Skip if this open time already passed today
|
||||||
|
if check_datetime <= market_now:
|
||||||
|
continue
|
||||||
|
|
||||||
|
# Convert to UTC for comparison
|
||||||
|
check_datetime_utc = check_datetime.astimezone(ZoneInfo("UTC"))
|
||||||
|
|
||||||
|
if next_open_time is None or check_datetime_utc < next_open_time:
|
||||||
|
next_open_time = check_datetime_utc
|
||||||
|
next_market = market
|
||||||
|
break
|
||||||
|
|
||||||
|
if next_market is None or next_open_time is None:
|
||||||
|
raise ValueError("Could not find next market open time")
|
||||||
|
|
||||||
|
return next_market, next_open_time
|
||||||
@@ -20,4 +20,5 @@ def settings() -> Settings:
|
|||||||
FAT_FINGER_PCT=30.0,
|
FAT_FINGER_PCT=30.0,
|
||||||
CONFIDENCE_THRESHOLD=80,
|
CONFIDENCE_THRESHOLD=80,
|
||||||
DB_PATH=":memory:",
|
DB_PATH=":memory:",
|
||||||
|
ENABLED_MARKETS="KR",
|
||||||
)
|
)
|
||||||
|
|||||||
@@ -2,12 +2,7 @@
|
|||||||
|
|
||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
from unittest.mock import AsyncMock, MagicMock, patch
|
from src.brain.gemini_client import GeminiClient
|
||||||
|
|
||||||
import pytest
|
|
||||||
|
|
||||||
from src.brain.gemini_client import GeminiClient, TradeDecision
|
|
||||||
|
|
||||||
|
|
||||||
# ---------------------------------------------------------------------------
|
# ---------------------------------------------------------------------------
|
||||||
# Response Parsing
|
# Response Parsing
|
||||||
|
|||||||
@@ -3,14 +3,12 @@
|
|||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
import asyncio
|
import asyncio
|
||||||
from unittest.mock import AsyncMock, MagicMock, patch
|
from unittest.mock import AsyncMock, patch
|
||||||
|
|
||||||
import aiohttp
|
|
||||||
import pytest
|
import pytest
|
||||||
|
|
||||||
from src.broker.kis_api import KISBroker
|
from src.broker.kis_api import KISBroker
|
||||||
|
|
||||||
|
|
||||||
# ---------------------------------------------------------------------------
|
# ---------------------------------------------------------------------------
|
||||||
# Token Management
|
# Token Management
|
||||||
# ---------------------------------------------------------------------------
|
# ---------------------------------------------------------------------------
|
||||||
@@ -68,7 +66,7 @@ class TestNetworkErrorHandling:
|
|||||||
|
|
||||||
with patch(
|
with patch(
|
||||||
"aiohttp.ClientSession.get",
|
"aiohttp.ClientSession.get",
|
||||||
side_effect=asyncio.TimeoutError(),
|
side_effect=TimeoutError(),
|
||||||
):
|
):
|
||||||
with pytest.raises(ConnectionError):
|
with pytest.raises(ConnectionError):
|
||||||
await broker.get_orderbook("005930")
|
await broker.get_orderbook("005930")
|
||||||
|
|||||||
350
tests/test_context.py
Normal file
350
tests/test_context.py
Normal file
@@ -0,0 +1,350 @@
|
|||||||
|
"""Tests for the multi-layered context management system."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import sqlite3
|
||||||
|
from datetime import UTC, datetime, timedelta
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from src.context.aggregator import ContextAggregator
|
||||||
|
from src.context.layer import LAYER_CONFIG, ContextLayer
|
||||||
|
from src.context.store import ContextStore
|
||||||
|
from src.db import init_db, log_trade
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def db_conn() -> sqlite3.Connection:
|
||||||
|
"""Provide an in-memory database connection."""
|
||||||
|
return init_db(":memory:")
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def store(db_conn: sqlite3.Connection) -> ContextStore:
|
||||||
|
"""Provide a ContextStore instance."""
|
||||||
|
return ContextStore(db_conn)
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def aggregator(db_conn: sqlite3.Connection) -> ContextAggregator:
|
||||||
|
"""Provide a ContextAggregator instance."""
|
||||||
|
return ContextAggregator(db_conn)
|
||||||
|
|
||||||
|
|
||||||
|
class TestContextStore:
|
||||||
|
"""Test suite for ContextStore CRUD operations."""
|
||||||
|
|
||||||
|
def test_set_and_get_context(self, store: ContextStore) -> None:
|
||||||
|
"""Test setting and retrieving a context value."""
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl", 1234.56)
|
||||||
|
|
||||||
|
value = store.get_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl")
|
||||||
|
assert value == 1234.56
|
||||||
|
|
||||||
|
def test_get_nonexistent_context(self, store: ContextStore) -> None:
|
||||||
|
"""Test retrieving a non-existent context returns None."""
|
||||||
|
value = store.get_context(ContextLayer.L6_DAILY, "2026-02-04", "nonexistent")
|
||||||
|
assert value is None
|
||||||
|
|
||||||
|
def test_update_existing_context(self, store: ContextStore) -> None:
|
||||||
|
"""Test updating an existing context value."""
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl", 100.0)
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl", 200.0)
|
||||||
|
|
||||||
|
value = store.get_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl")
|
||||||
|
assert value == 200.0
|
||||||
|
|
||||||
|
def test_get_all_contexts_for_layer(self, store: ContextStore) -> None:
|
||||||
|
"""Test retrieving all contexts for a specific layer."""
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "total_pnl", 100.0)
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "trade_count", 10)
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-04", "win_rate", 60.5)
|
||||||
|
|
||||||
|
contexts = store.get_all_contexts(ContextLayer.L6_DAILY, "2026-02-04")
|
||||||
|
assert len(contexts) == 3
|
||||||
|
assert contexts["total_pnl"] == 100.0
|
||||||
|
assert contexts["trade_count"] == 10
|
||||||
|
assert contexts["win_rate"] == 60.5
|
||||||
|
|
||||||
|
def test_get_latest_timeframe(self, store: ContextStore) -> None:
|
||||||
|
"""Test getting the most recent timeframe for a layer."""
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-01", "total_pnl", 100.0)
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-03", "total_pnl", 200.0)
|
||||||
|
store.set_context(ContextLayer.L6_DAILY, "2026-02-02", "total_pnl", 150.0)
|
||||||
|
|
||||||
|
latest = store.get_latest_timeframe(ContextLayer.L6_DAILY)
|
||||||
|
# Latest by updated_at, which should be the last one set
|
||||||
|
assert latest == "2026-02-02"
|
||||||
|
|
||||||
|
def test_delete_old_contexts(
|
||||||
|
self, store: ContextStore, db_conn: sqlite3.Connection
|
||||||
|
) -> None:
|
||||||
|
"""Test deleting contexts older than a cutoff date."""
|
||||||
|
# Insert contexts with specific old timestamps
|
||||||
|
# (bypassing set_context which uses current time)
|
||||||
|
old_date = "2026-01-01T00:00:00+00:00"
|
||||||
|
new_date = "2026-02-01T00:00:00+00:00"
|
||||||
|
|
||||||
|
db_conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT INTO contexts (layer, timeframe, key, value, created_at, updated_at)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?)
|
||||||
|
""",
|
||||||
|
(ContextLayer.L6_DAILY.value, "2026-01-01", "total_pnl", "100.0", old_date, old_date),
|
||||||
|
)
|
||||||
|
db_conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT INTO contexts (layer, timeframe, key, value, created_at, updated_at)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?)
|
||||||
|
""",
|
||||||
|
(ContextLayer.L6_DAILY.value, "2026-02-01", "total_pnl", "200.0", new_date, new_date),
|
||||||
|
)
|
||||||
|
db_conn.commit()
|
||||||
|
|
||||||
|
# Delete contexts before 2026-01-15
|
||||||
|
cutoff = "2026-01-15T00:00:00+00:00"
|
||||||
|
deleted = store.delete_old_contexts(ContextLayer.L6_DAILY, cutoff)
|
||||||
|
|
||||||
|
# Should delete the 2026-01-01 context
|
||||||
|
assert deleted == 1
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, "2026-02-01", "total_pnl") == 200.0
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, "2026-01-01", "total_pnl") is None
|
||||||
|
|
||||||
|
def test_cleanup_expired_contexts(
|
||||||
|
self, store: ContextStore, db_conn: sqlite3.Connection
|
||||||
|
) -> None:
|
||||||
|
"""Test automatic cleanup based on retention policies."""
|
||||||
|
# Set old contexts for L7 (7 day retention)
|
||||||
|
old_date = (datetime.now(UTC) - timedelta(days=10)).isoformat()
|
||||||
|
db_conn.execute(
|
||||||
|
"""
|
||||||
|
INSERT INTO contexts (layer, timeframe, key, value, created_at, updated_at)
|
||||||
|
VALUES (?, ?, ?, ?, ?, ?)
|
||||||
|
""",
|
||||||
|
(ContextLayer.L7_REALTIME.value, "2026-01-01", "price", "100.0", old_date, old_date),
|
||||||
|
)
|
||||||
|
db_conn.commit()
|
||||||
|
|
||||||
|
deleted_counts = store.cleanup_expired_contexts()
|
||||||
|
|
||||||
|
# Should delete the old L7 context (10 days > 7 day retention)
|
||||||
|
assert deleted_counts[ContextLayer.L7_REALTIME] == 1
|
||||||
|
|
||||||
|
# L1 has no retention limit, so nothing should be deleted
|
||||||
|
assert deleted_counts[ContextLayer.L1_LEGACY] == 0
|
||||||
|
|
||||||
|
def test_context_metadata_initialized(
|
||||||
|
self, store: ContextStore, db_conn: sqlite3.Connection
|
||||||
|
) -> None:
|
||||||
|
"""Test that context metadata is properly initialized."""
|
||||||
|
cursor = db_conn.execute("SELECT COUNT(*) FROM context_metadata")
|
||||||
|
count = cursor.fetchone()[0]
|
||||||
|
|
||||||
|
# Should have metadata for all 7 layers
|
||||||
|
assert count == 7
|
||||||
|
|
||||||
|
# Verify L1 metadata
|
||||||
|
cursor = db_conn.execute(
|
||||||
|
"SELECT description, retention_days FROM context_metadata WHERE layer = ?",
|
||||||
|
(ContextLayer.L1_LEGACY.value,),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
assert row is not None
|
||||||
|
assert "Cumulative trading history" in row[0]
|
||||||
|
assert row[1] is None # No retention limit for L1
|
||||||
|
|
||||||
|
|
||||||
|
class TestContextAggregator:
|
||||||
|
"""Test suite for ContextAggregator."""
|
||||||
|
|
||||||
|
def test_aggregate_daily_from_trades(
|
||||||
|
self, aggregator: ContextAggregator, db_conn: sqlite3.Connection
|
||||||
|
) -> None:
|
||||||
|
"""Test aggregating daily metrics from trades."""
|
||||||
|
date = "2026-02-04"
|
||||||
|
|
||||||
|
# Create sample trades
|
||||||
|
log_trade(db_conn, "005930", "BUY", 85, "Good signal", quantity=10, price=70000, pnl=500)
|
||||||
|
log_trade(db_conn, "000660", "SELL", 90, "Take profit", quantity=5, price=50000, pnl=1500)
|
||||||
|
log_trade(db_conn, "035720", "HOLD", 75, "Wait", quantity=0, price=0, pnl=0)
|
||||||
|
|
||||||
|
# Manually set timestamps to the target date
|
||||||
|
db_conn.execute(
|
||||||
|
f"UPDATE trades SET timestamp = '{date}T10:00:00+00:00'"
|
||||||
|
)
|
||||||
|
db_conn.commit()
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_daily_from_trades(date)
|
||||||
|
|
||||||
|
# Verify L6 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "trade_count") == 3
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "buys") == 1
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "sells") == 1
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "holds") == 1
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "total_pnl") == 2000.0
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "unique_stocks") == 3
|
||||||
|
# 2 wins, 0 losses
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "win_rate") == 100.0
|
||||||
|
|
||||||
|
def test_aggregate_weekly_from_daily(self, aggregator: ContextAggregator) -> None:
|
||||||
|
"""Test aggregating weekly metrics from daily."""
|
||||||
|
week = "2026-W06"
|
||||||
|
|
||||||
|
# Set daily contexts
|
||||||
|
aggregator.store.set_context(ContextLayer.L6_DAILY, "2026-02-02", "total_pnl", 100.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L6_DAILY, "2026-02-03", "total_pnl", 200.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L6_DAILY, "2026-02-02", "avg_confidence", 80.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L6_DAILY, "2026-02-03", "avg_confidence", 85.0)
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_weekly_from_daily(week)
|
||||||
|
|
||||||
|
# Verify L5 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
weekly_pnl = store.get_context(ContextLayer.L5_WEEKLY, week, "weekly_pnl")
|
||||||
|
avg_conf = store.get_context(ContextLayer.L5_WEEKLY, week, "avg_confidence")
|
||||||
|
|
||||||
|
assert weekly_pnl == 300.0
|
||||||
|
assert avg_conf == 82.5
|
||||||
|
|
||||||
|
def test_aggregate_monthly_from_weekly(self, aggregator: ContextAggregator) -> None:
|
||||||
|
"""Test aggregating monthly metrics from weekly."""
|
||||||
|
month = "2026-02"
|
||||||
|
|
||||||
|
# Set weekly contexts
|
||||||
|
aggregator.store.set_context(ContextLayer.L5_WEEKLY, "2026-W05", "weekly_pnl", 100.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L5_WEEKLY, "2026-W06", "weekly_pnl", 200.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L5_WEEKLY, "2026-W07", "weekly_pnl", 150.0)
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_monthly_from_weekly(month)
|
||||||
|
|
||||||
|
# Verify L4 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
monthly_pnl = store.get_context(ContextLayer.L4_MONTHLY, month, "monthly_pnl")
|
||||||
|
assert monthly_pnl == 450.0
|
||||||
|
|
||||||
|
def test_aggregate_quarterly_from_monthly(self, aggregator: ContextAggregator) -> None:
|
||||||
|
"""Test aggregating quarterly metrics from monthly."""
|
||||||
|
quarter = "2026-Q1"
|
||||||
|
|
||||||
|
# Set monthly contexts for Q1 (Jan, Feb, Mar)
|
||||||
|
aggregator.store.set_context(ContextLayer.L4_MONTHLY, "2026-01", "monthly_pnl", 1000.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L4_MONTHLY, "2026-02", "monthly_pnl", 2000.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L4_MONTHLY, "2026-03", "monthly_pnl", 1500.0)
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_quarterly_from_monthly(quarter)
|
||||||
|
|
||||||
|
# Verify L3 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
quarterly_pnl = store.get_context(ContextLayer.L3_QUARTERLY, quarter, "quarterly_pnl")
|
||||||
|
assert quarterly_pnl == 4500.0
|
||||||
|
|
||||||
|
def test_aggregate_annual_from_quarterly(self, aggregator: ContextAggregator) -> None:
|
||||||
|
"""Test aggregating annual metrics from quarterly."""
|
||||||
|
year = "2026"
|
||||||
|
|
||||||
|
# Set quarterly contexts for all 4 quarters
|
||||||
|
aggregator.store.set_context(ContextLayer.L3_QUARTERLY, "2026-Q1", "quarterly_pnl", 4500.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L3_QUARTERLY, "2026-Q2", "quarterly_pnl", 5000.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L3_QUARTERLY, "2026-Q3", "quarterly_pnl", 4800.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L3_QUARTERLY, "2026-Q4", "quarterly_pnl", 5200.0)
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_annual_from_quarterly(year)
|
||||||
|
|
||||||
|
# Verify L2 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
annual_pnl = store.get_context(ContextLayer.L2_ANNUAL, year, "annual_pnl")
|
||||||
|
assert annual_pnl == 19500.0
|
||||||
|
|
||||||
|
def test_aggregate_legacy_from_annual(self, aggregator: ContextAggregator) -> None:
|
||||||
|
"""Test aggregating legacy metrics from all annual data."""
|
||||||
|
# Set annual contexts for multiple years
|
||||||
|
aggregator.store.set_context(ContextLayer.L2_ANNUAL, "2024", "annual_pnl", 10000.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L2_ANNUAL, "2025", "annual_pnl", 15000.0)
|
||||||
|
aggregator.store.set_context(ContextLayer.L2_ANNUAL, "2026", "annual_pnl", 20000.0)
|
||||||
|
|
||||||
|
# Aggregate
|
||||||
|
aggregator.aggregate_legacy_from_annual()
|
||||||
|
|
||||||
|
# Verify L1 contexts
|
||||||
|
store = aggregator.store
|
||||||
|
total_pnl = store.get_context(ContextLayer.L1_LEGACY, "LEGACY", "total_pnl")
|
||||||
|
years_traded = store.get_context(ContextLayer.L1_LEGACY, "LEGACY", "years_traded")
|
||||||
|
avg_annual_pnl = store.get_context(ContextLayer.L1_LEGACY, "LEGACY", "avg_annual_pnl")
|
||||||
|
|
||||||
|
assert total_pnl == 45000.0
|
||||||
|
assert years_traded == 3
|
||||||
|
assert avg_annual_pnl == 15000.0
|
||||||
|
|
||||||
|
def test_run_all_aggregations(
|
||||||
|
self, aggregator: ContextAggregator, db_conn: sqlite3.Connection
|
||||||
|
) -> None:
|
||||||
|
"""Test running all aggregations from L7 to L1."""
|
||||||
|
date = "2026-02-04"
|
||||||
|
|
||||||
|
# Create sample trades
|
||||||
|
log_trade(db_conn, "005930", "BUY", 85, "Good signal", quantity=10, price=70000, pnl=1000)
|
||||||
|
|
||||||
|
# Set timestamp
|
||||||
|
db_conn.execute(f"UPDATE trades SET timestamp = '{date}T10:00:00+00:00'")
|
||||||
|
db_conn.commit()
|
||||||
|
|
||||||
|
# Run all aggregations
|
||||||
|
aggregator.run_all_aggregations()
|
||||||
|
|
||||||
|
# Verify data exists in each layer
|
||||||
|
store = aggregator.store
|
||||||
|
assert store.get_context(ContextLayer.L6_DAILY, date, "total_pnl") == 1000.0
|
||||||
|
current_week = datetime.now(UTC).strftime("%Y-W%V")
|
||||||
|
assert store.get_context(ContextLayer.L5_WEEKLY, current_week, "weekly_pnl") is not None
|
||||||
|
# Further layers depend on time alignment, just verify no crashes
|
||||||
|
|
||||||
|
|
||||||
|
class TestLayerMetadata:
|
||||||
|
"""Test suite for layer metadata configuration."""
|
||||||
|
|
||||||
|
def test_all_layers_have_metadata(self) -> None:
|
||||||
|
"""Test that all 7 layers have metadata defined."""
|
||||||
|
assert len(LAYER_CONFIG) == 7
|
||||||
|
|
||||||
|
for layer in ContextLayer:
|
||||||
|
assert layer in LAYER_CONFIG
|
||||||
|
|
||||||
|
def test_layer_retention_policies(self) -> None:
|
||||||
|
"""Test layer retention policies are correctly configured."""
|
||||||
|
# L1 should have no retention limit
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L1_LEGACY].retention_days is None
|
||||||
|
|
||||||
|
# L7 should have the shortest retention (7 days)
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L7_REALTIME].retention_days == 7
|
||||||
|
|
||||||
|
# L2 should have a long retention (10 years)
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L2_ANNUAL].retention_days == 365 * 10
|
||||||
|
|
||||||
|
def test_layer_aggregation_chain(self) -> None:
|
||||||
|
"""Test that the aggregation chain is properly configured."""
|
||||||
|
# L7 has no source (leaf layer)
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L7_REALTIME].aggregation_source is None
|
||||||
|
|
||||||
|
# L6 aggregates from L7
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L6_DAILY].aggregation_source == ContextLayer.L7_REALTIME
|
||||||
|
|
||||||
|
# L5 aggregates from L6
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L5_WEEKLY].aggregation_source == ContextLayer.L6_DAILY
|
||||||
|
|
||||||
|
# L4 aggregates from L5
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L4_MONTHLY].aggregation_source == ContextLayer.L5_WEEKLY
|
||||||
|
|
||||||
|
# L3 aggregates from L4
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L3_QUARTERLY].aggregation_source == ContextLayer.L4_MONTHLY
|
||||||
|
|
||||||
|
# L2 aggregates from L3
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L2_ANNUAL].aggregation_source == ContextLayer.L3_QUARTERLY
|
||||||
|
|
||||||
|
# L1 aggregates from L2
|
||||||
|
assert LAYER_CONFIG[ContextLayer.L1_LEGACY].aggregation_source == ContextLayer.L2_ANNUAL
|
||||||
292
tests/test_decision_logger.py
Normal file
292
tests/test_decision_logger.py
Normal file
@@ -0,0 +1,292 @@
|
|||||||
|
"""Tests for decision logging and audit trail."""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import sqlite3
|
||||||
|
from datetime import UTC, datetime
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from src.db import init_db
|
||||||
|
from src.logging.decision_logger import DecisionLog, DecisionLogger
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def db_conn() -> sqlite3.Connection:
|
||||||
|
"""Provide an in-memory database with initialized schema."""
|
||||||
|
conn = init_db(":memory:")
|
||||||
|
return conn
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def logger(db_conn: sqlite3.Connection) -> DecisionLogger:
|
||||||
|
"""Provide a DecisionLogger instance."""
|
||||||
|
return DecisionLogger(db_conn)
|
||||||
|
|
||||||
|
|
||||||
|
def test_log_decision_creates_record(logger: DecisionLogger, db_conn: sqlite3.Connection) -> None:
|
||||||
|
"""Test that log_decision creates a database record."""
|
||||||
|
context_snapshot = {
|
||||||
|
"L1": {"quote": {"price": 100.0, "volume": 1000}},
|
||||||
|
"L2": {"orderbook": {"bid": [99.0], "ask": [101.0]}},
|
||||||
|
}
|
||||||
|
input_data = {"price": 100.0, "volume": 1000, "foreigner_net": 500}
|
||||||
|
|
||||||
|
decision_id = logger.log_decision(
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=85,
|
||||||
|
rationale="Strong upward momentum",
|
||||||
|
context_snapshot=context_snapshot,
|
||||||
|
input_data=input_data,
|
||||||
|
)
|
||||||
|
|
||||||
|
# Verify decision_id is a valid UUID
|
||||||
|
assert decision_id is not None
|
||||||
|
assert len(decision_id) == 36 # UUID v4 format
|
||||||
|
|
||||||
|
# Verify record exists in database
|
||||||
|
cursor = db_conn.execute(
|
||||||
|
"SELECT decision_id, action, confidence FROM decision_logs WHERE decision_id = ?",
|
||||||
|
(decision_id,),
|
||||||
|
)
|
||||||
|
row = cursor.fetchone()
|
||||||
|
assert row is not None
|
||||||
|
assert row[0] == decision_id
|
||||||
|
assert row[1] == "BUY"
|
||||||
|
assert row[2] == 85
|
||||||
|
|
||||||
|
|
||||||
|
def test_log_decision_stores_context_snapshot(logger: DecisionLogger) -> None:
|
||||||
|
"""Test that context snapshot is stored as JSON."""
|
||||||
|
context_snapshot = {
|
||||||
|
"L1": {"real_time": "data"},
|
||||||
|
"L3": {"daily": "aggregate"},
|
||||||
|
"L7": {"legacy": "wisdom"},
|
||||||
|
}
|
||||||
|
input_data = {"price": 50000.0, "volume": 2000}
|
||||||
|
|
||||||
|
decision_id = logger.log_decision(
|
||||||
|
stock_code="035420",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="HOLD",
|
||||||
|
confidence=75,
|
||||||
|
rationale="Waiting for clearer signal",
|
||||||
|
context_snapshot=context_snapshot,
|
||||||
|
input_data=input_data,
|
||||||
|
)
|
||||||
|
|
||||||
|
# Retrieve and verify context snapshot
|
||||||
|
decision = logger.get_decision_by_id(decision_id)
|
||||||
|
assert decision is not None
|
||||||
|
assert decision.context_snapshot == context_snapshot
|
||||||
|
assert decision.input_data == input_data
|
||||||
|
|
||||||
|
|
||||||
|
def test_get_unreviewed_decisions(logger: DecisionLogger) -> None:
|
||||||
|
"""Test retrieving unreviewed decisions with confidence filter."""
|
||||||
|
# Log multiple decisions with varying confidence
|
||||||
|
logger.log_decision(
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=90,
|
||||||
|
rationale="High confidence buy",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
logger.log_decision(
|
||||||
|
stock_code="000660",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="SELL",
|
||||||
|
confidence=75,
|
||||||
|
rationale="Low confidence sell",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
logger.log_decision(
|
||||||
|
stock_code="035420",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="HOLD",
|
||||||
|
confidence=85,
|
||||||
|
rationale="Medium confidence hold",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
|
||||||
|
# Get unreviewed decisions with default threshold (80)
|
||||||
|
unreviewed = logger.get_unreviewed_decisions()
|
||||||
|
assert len(unreviewed) == 2 # Only confidence >= 80
|
||||||
|
assert all(d.confidence >= 80 for d in unreviewed)
|
||||||
|
assert all(not d.reviewed for d in unreviewed)
|
||||||
|
|
||||||
|
# Get with lower threshold
|
||||||
|
unreviewed_all = logger.get_unreviewed_decisions(min_confidence=70)
|
||||||
|
assert len(unreviewed_all) == 3
|
||||||
|
|
||||||
|
|
||||||
|
def test_mark_reviewed(logger: DecisionLogger) -> None:
|
||||||
|
"""Test marking a decision as reviewed."""
|
||||||
|
decision_id = logger.log_decision(
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=85,
|
||||||
|
rationale="Test decision",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
|
||||||
|
# Initially unreviewed
|
||||||
|
decision = logger.get_decision_by_id(decision_id)
|
||||||
|
assert decision is not None
|
||||||
|
assert not decision.reviewed
|
||||||
|
assert decision.review_notes is None
|
||||||
|
|
||||||
|
# Mark as reviewed
|
||||||
|
review_notes = "Good decision, captured bullish momentum correctly"
|
||||||
|
logger.mark_reviewed(decision_id, review_notes)
|
||||||
|
|
||||||
|
# Verify updated
|
||||||
|
decision = logger.get_decision_by_id(decision_id)
|
||||||
|
assert decision is not None
|
||||||
|
assert decision.reviewed
|
||||||
|
assert decision.review_notes == review_notes
|
||||||
|
|
||||||
|
# Should not appear in unreviewed list
|
||||||
|
unreviewed = logger.get_unreviewed_decisions()
|
||||||
|
assert all(d.decision_id != decision_id for d in unreviewed)
|
||||||
|
|
||||||
|
|
||||||
|
def test_update_outcome(logger: DecisionLogger) -> None:
|
||||||
|
"""Test updating decision outcome with P&L and accuracy."""
|
||||||
|
decision_id = logger.log_decision(
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=90,
|
||||||
|
rationale="Expecting price increase",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
|
||||||
|
# Initially no outcome
|
||||||
|
decision = logger.get_decision_by_id(decision_id)
|
||||||
|
assert decision is not None
|
||||||
|
assert decision.outcome_pnl is None
|
||||||
|
assert decision.outcome_accuracy is None
|
||||||
|
|
||||||
|
# Update outcome (profitable trade)
|
||||||
|
logger.update_outcome(decision_id, pnl=5000.0, accuracy=1)
|
||||||
|
|
||||||
|
# Verify updated
|
||||||
|
decision = logger.get_decision_by_id(decision_id)
|
||||||
|
assert decision is not None
|
||||||
|
assert decision.outcome_pnl == 5000.0
|
||||||
|
assert decision.outcome_accuracy == 1
|
||||||
|
|
||||||
|
|
||||||
|
def test_get_losing_decisions(logger: DecisionLogger) -> None:
|
||||||
|
"""Test retrieving high-confidence losing decisions."""
|
||||||
|
# Profitable decision
|
||||||
|
id1 = logger.log_decision(
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=85,
|
||||||
|
rationale="Correct prediction",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
logger.update_outcome(id1, pnl=3000.0, accuracy=1)
|
||||||
|
|
||||||
|
# High-confidence loss
|
||||||
|
id2 = logger.log_decision(
|
||||||
|
stock_code="000660",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="SELL",
|
||||||
|
confidence=90,
|
||||||
|
rationale="Wrong prediction",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
logger.update_outcome(id2, pnl=-2000.0, accuracy=0)
|
||||||
|
|
||||||
|
# Low-confidence loss (should be ignored)
|
||||||
|
id3 = logger.log_decision(
|
||||||
|
stock_code="035420",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=70,
|
||||||
|
rationale="Low confidence, wrong",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
logger.update_outcome(id3, pnl=-1500.0, accuracy=0)
|
||||||
|
|
||||||
|
# Get high-confidence losing decisions
|
||||||
|
losers = logger.get_losing_decisions(min_confidence=80, min_loss=-1000.0)
|
||||||
|
assert len(losers) == 1
|
||||||
|
assert losers[0].decision_id == id2
|
||||||
|
assert losers[0].outcome_pnl == -2000.0
|
||||||
|
assert losers[0].confidence == 90
|
||||||
|
|
||||||
|
|
||||||
|
def test_get_decision_by_id_not_found(logger: DecisionLogger) -> None:
|
||||||
|
"""Test that get_decision_by_id returns None for non-existent ID."""
|
||||||
|
decision = logger.get_decision_by_id("non-existent-uuid")
|
||||||
|
assert decision is None
|
||||||
|
|
||||||
|
|
||||||
|
def test_unreviewed_limit(logger: DecisionLogger) -> None:
|
||||||
|
"""Test that get_unreviewed_decisions respects limit parameter."""
|
||||||
|
# Create 5 unreviewed decisions
|
||||||
|
for i in range(5):
|
||||||
|
logger.log_decision(
|
||||||
|
stock_code=f"00{i}",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="HOLD",
|
||||||
|
confidence=85,
|
||||||
|
rationale=f"Decision {i}",
|
||||||
|
context_snapshot={},
|
||||||
|
input_data={},
|
||||||
|
)
|
||||||
|
|
||||||
|
# Get only 3
|
||||||
|
unreviewed = logger.get_unreviewed_decisions(limit=3)
|
||||||
|
assert len(unreviewed) == 3
|
||||||
|
|
||||||
|
|
||||||
|
def test_decision_log_dataclass() -> None:
|
||||||
|
"""Test DecisionLog dataclass creation."""
|
||||||
|
now = datetime.now(UTC).isoformat()
|
||||||
|
log = DecisionLog(
|
||||||
|
decision_id="test-uuid",
|
||||||
|
timestamp=now,
|
||||||
|
stock_code="005930",
|
||||||
|
market="KR",
|
||||||
|
exchange_code="KRX",
|
||||||
|
action="BUY",
|
||||||
|
confidence=85,
|
||||||
|
rationale="Test",
|
||||||
|
context_snapshot={"L1": "data"},
|
||||||
|
input_data={"price": 100.0},
|
||||||
|
)
|
||||||
|
|
||||||
|
assert log.decision_id == "test-uuid"
|
||||||
|
assert log.action == "BUY"
|
||||||
|
assert log.confidence == 85
|
||||||
|
assert log.reviewed is False
|
||||||
|
assert log.outcome_pnl is None
|
||||||
201
tests/test_market_schedule.py
Normal file
201
tests/test_market_schedule.py
Normal file
@@ -0,0 +1,201 @@
|
|||||||
|
"""Tests for market schedule management."""
|
||||||
|
|
||||||
|
from datetime import datetime
|
||||||
|
from zoneinfo import ZoneInfo
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from src.markets.schedule import (
|
||||||
|
MARKETS,
|
||||||
|
get_next_market_open,
|
||||||
|
get_open_markets,
|
||||||
|
is_market_open,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
class TestMarketInfo:
|
||||||
|
"""Test MarketInfo dataclass."""
|
||||||
|
|
||||||
|
def test_market_info_immutable(self) -> None:
|
||||||
|
"""MarketInfo should be frozen."""
|
||||||
|
market = MARKETS["KR"]
|
||||||
|
with pytest.raises(AttributeError):
|
||||||
|
market.code = "US" # type: ignore[misc]
|
||||||
|
|
||||||
|
def test_all_markets_defined(self) -> None:
|
||||||
|
"""All 10 markets should be defined."""
|
||||||
|
expected_markets = {
|
||||||
|
"KR",
|
||||||
|
"US_NASDAQ",
|
||||||
|
"US_NYSE",
|
||||||
|
"US_AMEX",
|
||||||
|
"JP",
|
||||||
|
"HK",
|
||||||
|
"CN_SHA",
|
||||||
|
"CN_SZA",
|
||||||
|
"VN_HAN",
|
||||||
|
"VN_HCM",
|
||||||
|
}
|
||||||
|
assert set(MARKETS.keys()) == expected_markets
|
||||||
|
|
||||||
|
|
||||||
|
class TestIsMarketOpen:
|
||||||
|
"""Test is_market_open function."""
|
||||||
|
|
||||||
|
def test_kr_market_open_weekday(self) -> None:
|
||||||
|
"""KR market should be open during trading hours on weekday."""
|
||||||
|
# Monday 2026-02-02 10:00 KST
|
||||||
|
test_time = datetime(2026, 2, 2, 10, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
def test_kr_market_closed_before_open(self) -> None:
|
||||||
|
"""KR market should be closed before 9:00."""
|
||||||
|
# Monday 2026-02-02 08:30 KST
|
||||||
|
test_time = datetime(2026, 2, 2, 8, 30, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert not is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
def test_kr_market_closed_after_close(self) -> None:
|
||||||
|
"""KR market should be closed after 15:30."""
|
||||||
|
# Monday 2026-02-02 15:30 KST (exact close time)
|
||||||
|
test_time = datetime(2026, 2, 2, 15, 30, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert not is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
def test_kr_market_closed_weekend(self) -> None:
|
||||||
|
"""KR market should be closed on weekends."""
|
||||||
|
# Saturday 2026-02-07 10:00 KST
|
||||||
|
test_time = datetime(2026, 2, 7, 10, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert not is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
# Sunday 2026-02-08 10:00 KST
|
||||||
|
test_time = datetime(2026, 2, 8, 10, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert not is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
def test_us_nasdaq_open_with_dst(self) -> None:
|
||||||
|
"""US markets should respect DST."""
|
||||||
|
# Monday 2026-06-01 10:00 EDT (DST in effect)
|
||||||
|
test_time = datetime(2026, 6, 1, 10, 0, tzinfo=ZoneInfo("America/New_York"))
|
||||||
|
assert is_market_open(MARKETS["US_NASDAQ"], test_time)
|
||||||
|
|
||||||
|
# Monday 2026-12-07 10:00 EST (no DST)
|
||||||
|
test_time = datetime(2026, 12, 7, 10, 0, tzinfo=ZoneInfo("America/New_York"))
|
||||||
|
assert is_market_open(MARKETS["US_NASDAQ"], test_time)
|
||||||
|
|
||||||
|
def test_jp_market_lunch_break(self) -> None:
|
||||||
|
"""JP market should be closed during lunch break."""
|
||||||
|
# Monday 2026-02-02 12:00 JST (lunch break)
|
||||||
|
test_time = datetime(2026, 2, 2, 12, 0, tzinfo=ZoneInfo("Asia/Tokyo"))
|
||||||
|
assert not is_market_open(MARKETS["JP"], test_time)
|
||||||
|
|
||||||
|
# Before lunch
|
||||||
|
test_time = datetime(2026, 2, 2, 11, 0, tzinfo=ZoneInfo("Asia/Tokyo"))
|
||||||
|
assert is_market_open(MARKETS["JP"], test_time)
|
||||||
|
|
||||||
|
# After lunch
|
||||||
|
test_time = datetime(2026, 2, 2, 13, 0, tzinfo=ZoneInfo("Asia/Tokyo"))
|
||||||
|
assert is_market_open(MARKETS["JP"], test_time)
|
||||||
|
|
||||||
|
def test_hk_market_lunch_break(self) -> None:
|
||||||
|
"""HK market should be closed during lunch break."""
|
||||||
|
# Monday 2026-02-02 12:30 HKT (lunch break)
|
||||||
|
test_time = datetime(2026, 2, 2, 12, 30, tzinfo=ZoneInfo("Asia/Hong_Kong"))
|
||||||
|
assert not is_market_open(MARKETS["HK"], test_time)
|
||||||
|
|
||||||
|
def test_timezone_conversion(self) -> None:
|
||||||
|
"""Should correctly convert timezones."""
|
||||||
|
# 2026-02-02 10:00 KST = 2026-02-02 01:00 UTC
|
||||||
|
test_time = datetime(2026, 2, 2, 1, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
assert is_market_open(MARKETS["KR"], test_time)
|
||||||
|
|
||||||
|
|
||||||
|
class TestGetOpenMarkets:
|
||||||
|
"""Test get_open_markets function."""
|
||||||
|
|
||||||
|
def test_get_open_markets_all_closed(self) -> None:
|
||||||
|
"""Should return empty list when all markets closed."""
|
||||||
|
# Sunday 2026-02-08 12:00 UTC (all markets closed)
|
||||||
|
test_time = datetime(2026, 2, 8, 12, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
assert get_open_markets(now=test_time) == []
|
||||||
|
|
||||||
|
def test_get_open_markets_kr_only(self) -> None:
|
||||||
|
"""Should return only KR when filtering enabled markets."""
|
||||||
|
# Monday 2026-02-02 10:00 KST = 01:00 UTC
|
||||||
|
test_time = datetime(2026, 2, 2, 1, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
open_markets = get_open_markets(enabled_markets=["KR"], now=test_time)
|
||||||
|
assert len(open_markets) == 1
|
||||||
|
assert open_markets[0].code == "KR"
|
||||||
|
|
||||||
|
def test_get_open_markets_multiple(self) -> None:
|
||||||
|
"""Should return multiple markets when open."""
|
||||||
|
# Monday 2026-02-02 14:30 EST = 19:30 UTC
|
||||||
|
# US markets: 9:30-16:00 EST → 14:30-21:00 UTC (open)
|
||||||
|
test_time = datetime(2026, 2, 2, 19, 30, tzinfo=ZoneInfo("UTC"))
|
||||||
|
open_markets = get_open_markets(
|
||||||
|
enabled_markets=["US_NASDAQ", "US_NYSE", "US_AMEX"], now=test_time
|
||||||
|
)
|
||||||
|
assert len(open_markets) == 3
|
||||||
|
codes = {m.code for m in open_markets}
|
||||||
|
assert codes == {"US_NASDAQ", "US_NYSE", "US_AMEX"}
|
||||||
|
|
||||||
|
def test_get_open_markets_sorted(self) -> None:
|
||||||
|
"""Should return markets sorted by code."""
|
||||||
|
# Monday 2026-02-02 14:30 EST
|
||||||
|
test_time = datetime(2026, 2, 2, 19, 30, tzinfo=ZoneInfo("UTC"))
|
||||||
|
open_markets = get_open_markets(
|
||||||
|
enabled_markets=["US_NYSE", "US_AMEX", "US_NASDAQ"], now=test_time
|
||||||
|
)
|
||||||
|
codes = [m.code for m in open_markets]
|
||||||
|
assert codes == sorted(codes)
|
||||||
|
|
||||||
|
|
||||||
|
class TestGetNextMarketOpen:
|
||||||
|
"""Test get_next_market_open function."""
|
||||||
|
|
||||||
|
def test_get_next_market_open_weekend(self) -> None:
|
||||||
|
"""Should find next Monday opening when called on weekend."""
|
||||||
|
# Saturday 2026-02-07 12:00 UTC
|
||||||
|
test_time = datetime(2026, 2, 7, 12, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
market, open_time = get_next_market_open(
|
||||||
|
enabled_markets=["KR"], now=test_time
|
||||||
|
)
|
||||||
|
assert market.code == "KR"
|
||||||
|
# Monday 2026-02-09 09:00 KST
|
||||||
|
expected = datetime(2026, 2, 9, 9, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert open_time == expected.astimezone(ZoneInfo("UTC"))
|
||||||
|
|
||||||
|
def test_get_next_market_open_after_close(self) -> None:
|
||||||
|
"""Should find next day opening when called after market close."""
|
||||||
|
# Monday 2026-02-02 16:00 KST (after close)
|
||||||
|
test_time = datetime(2026, 2, 2, 16, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
market, open_time = get_next_market_open(
|
||||||
|
enabled_markets=["KR"], now=test_time
|
||||||
|
)
|
||||||
|
assert market.code == "KR"
|
||||||
|
# Tuesday 2026-02-03 09:00 KST
|
||||||
|
expected = datetime(2026, 2, 3, 9, 0, tzinfo=ZoneInfo("Asia/Seoul"))
|
||||||
|
assert open_time == expected.astimezone(ZoneInfo("UTC"))
|
||||||
|
|
||||||
|
def test_get_next_market_open_multiple_markets(self) -> None:
|
||||||
|
"""Should find earliest opening market among multiple."""
|
||||||
|
# Saturday 2026-02-07 12:00 UTC
|
||||||
|
test_time = datetime(2026, 2, 7, 12, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
market, open_time = get_next_market_open(
|
||||||
|
enabled_markets=["KR", "US_NASDAQ"], now=test_time
|
||||||
|
)
|
||||||
|
# Monday 2026-02-09: KR opens at 09:00 KST = 00:00 UTC
|
||||||
|
# Monday 2026-02-09: US opens at 09:30 EST = 14:30 UTC
|
||||||
|
# KR opens first
|
||||||
|
assert market.code == "KR"
|
||||||
|
|
||||||
|
def test_get_next_market_open_no_markets(self) -> None:
|
||||||
|
"""Should raise ValueError when no markets enabled."""
|
||||||
|
test_time = datetime(2026, 2, 7, 12, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
with pytest.raises(ValueError, match="No enabled markets"):
|
||||||
|
get_next_market_open(enabled_markets=[], now=test_time)
|
||||||
|
|
||||||
|
def test_get_next_market_open_invalid_market(self) -> None:
|
||||||
|
"""Should skip invalid market codes."""
|
||||||
|
test_time = datetime(2026, 2, 7, 12, 0, tzinfo=ZoneInfo("UTC"))
|
||||||
|
market, _ = get_next_market_open(
|
||||||
|
enabled_markets=["INVALID", "KR"], now=test_time
|
||||||
|
)
|
||||||
|
assert market.code == "KR"
|
||||||
@@ -10,7 +10,6 @@ from src.core.risk_manager import (
|
|||||||
RiskManager,
|
RiskManager,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|
||||||
# ---------------------------------------------------------------------------
|
# ---------------------------------------------------------------------------
|
||||||
# Circuit Breaker Tests
|
# Circuit Breaker Tests
|
||||||
# ---------------------------------------------------------------------------
|
# ---------------------------------------------------------------------------
|
||||||
|
|||||||
Reference in New Issue
Block a user