Add CI for Phoenix devices by andrej · Pull Request #90 · amd/IRON

andrej · 2026-04-02T15:29:17Z

I've set this up on a Phoenix laptop in the FPGA lab. It seems to work. Activating it will be a small disruption because I'll have to update the Strix runner to use the new code as well (and we'll see if that part of it works as well when I update it and the first jobs run).

github-actions · 2026-04-07T22:09:55Z

📊 Test Results for Test Example Applications

311ef5f (2026_04_07_22_09_21)

IRONCLAD

Tested on 2026_04_07_22_09_21 at commit 311ef5f.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b_prompt_1024_tokens_1	✅ 5/5	2.13	n/a
llama_3.2_1b_prompt_1024_tokens_40	✅ 5/5	2.17	4.16
llama_3.2_1b_prompt_13_tokens_1	✅ 5/5	2.10	n/a
llama_3.2_1b_prompt_13_tokens_40	✅ 5/5	2.09	4.15

📈 Trends (vs main branch) for Test Example Applications

311ef5f (2026_04_07_22_09_21)

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`311ef5f` — 2026-04-07 22:03:35	2.14 (n/a)	2.13 (n/a)	2.14 (n/a)	2.10 (n/a)	0.02 (n/a)

llama_3.2_1b_prompt_1024_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`311ef5f` — 2026-04-07 22:03:35	4.18 (n/a)	4.16 (n/a)	4.15 (n/a)	4.15 (n/a)	0.01 (n/a)	2.27 (n/a)	2.17 (n/a)	2.15 (n/a)	2.13 (n/a)	0.06 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`311ef5f` — 2026-04-07 22:03:35	2.10 (n/a)	2.10 (n/a)	2.10 (n/a)	2.09 (n/a)	0.01 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`311ef5f` — 2026-04-07 22:03:35	4.18 (n/a)	4.15 (n/a)	4.15 (n/a)	4.13 (n/a)	0.02 (n/a)	2.10 (n/a)	2.09 (n/a)	2.09 (n/a)	2.08 (n/a)	0.01 (n/a)

github-actions · 2026-04-10T17:25:50Z

📊 Test Results for Test Example Applications

2a9d7b3 (2026_04_10_17_24_49)

IRONCLAD

Tested on 2026_04_10_17_24_49 at commit 2a9d7b3.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b_prompt_1024_tokens_1	✅ 5/5	2.12	n/a
llama_3.2_1b_prompt_1024_tokens_40	✅ 5/5	2.16	4.17
llama_3.2_1b_prompt_13_tokens_1	✅ 5/5	2.09	n/a
llama_3.2_1b_prompt_13_tokens_40	✅ 5/5	2.09	4.16

📈 Trends (vs main branch) for Test Example Applications

2a9d7b3 (2026_04_10_17_24_49)

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`2a9d7b3` — 2026-04-10 17:19:02	2.14 (n/a)	2.12 (n/a)	2.12 (n/a)	2.10 (n/a)	0.02 (n/a)

llama_3.2_1b_prompt_1024_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`2a9d7b3` — 2026-04-10 17:19:02	4.18 (n/a)	4.17 (n/a)	4.17 (n/a)	4.16 (n/a)	0.01 (n/a)	2.29 (n/a)	2.16 (n/a)	2.13 (n/a)	2.13 (n/a)	0.07 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`2a9d7b3` — 2026-04-10 17:19:02	2.12 (n/a)	2.09 (n/a)	2.09 (n/a)	2.07 (n/a)	0.02 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`2a9d7b3` — 2026-04-10 17:19:02	4.19 (n/a)	4.16 (n/a)	4.16 (n/a)	4.14 (n/a)	0.02 (n/a)	2.10 (n/a)	2.09 (n/a)	2.09 (n/a)	2.08 (n/a)	0.01 (n/a)

github-actions · 2026-04-14T00:22:47Z

📊 Test Results for Test Example Applications

e1489c9 (2026_04_14_00_22_27)

IRONCLAD

Tested on 2026_04_14_00_22_27 at commit e1489c9.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b_prompt_1024_tokens_1	✅ 5/5	2.13	n/a
llama_3.2_1b_prompt_1024_tokens_40	✅ 5/5	2.16	4.16
llama_3.2_1b_prompt_13_tokens_1	✅ 5/5	2.09	n/a
llama_3.2_1b_prompt_13_tokens_40	✅ 5/5	2.09	4.17

📈 Trends (vs main branch) for Test Example Applications

e1489c9 (2026_04_14_00_22_27)

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`e1489c9` — 2026-04-14 00:16:40	2.14 (n/a)	2.13 (n/a)	2.13 (n/a)	2.09 (n/a)	0.02 (n/a)

llama_3.2_1b_prompt_1024_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`e1489c9` — 2026-04-14 00:16:40	4.19 (n/a)	4.16 (n/a)	4.14 (n/a)	4.14 (n/a)	0.02 (n/a)	2.28 (n/a)	2.16 (n/a)	2.14 (n/a)	2.12 (n/a)	0.07 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`e1489c9` — 2026-04-14 00:16:40	2.10 (n/a)	2.09 (n/a)	2.08 (n/a)	2.08 (n/a)	0.01 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`e1489c9` — 2026-04-14 00:16:40	4.19 (n/a)	4.17 (n/a)	4.17 (n/a)	4.16 (n/a)	0.02 (n/a)	2.11 (n/a)	2.09 (n/a)	2.09 (n/a)	2.07 (n/a)	0.01 (n/a)

github-actions · 2026-04-14T04:13:46Z

📊 Test Results for Test Example Applications

8dac9c8 (2026_04_14_04_13_04)

IRONCLAD

Tested on 2026_04_14_04_13_04 at commit 8dac9c8.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b_prompt_1024_tokens_1	✅ 5/5	2.13	n/a
llama_3.2_1b_prompt_1024_tokens_40	✅ 5/5	2.15	4.17
llama_3.2_1b_prompt_13_tokens_1	✅ 5/5	2.07	n/a
llama_3.2_1b_prompt_13_tokens_40	✅ 5/5	2.09	4.18

📈 Trends (vs main branch) for Test Example Applications

8dac9c8 (2026_04_14_04_13_04)

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`8dac9c8` — 2026-04-14 04:07:17	2.15 (n/a)	2.13 (n/a)	2.13 (n/a)	2.12 (n/a)	0.01 (n/a)

llama_3.2_1b_prompt_1024_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`8dac9c8` — 2026-04-14 04:07:17	4.20 (n/a)	4.17 (n/a)	4.17 (n/a)	4.15 (n/a)	0.02 (n/a)	2.27 (n/a)	2.15 (n/a)	2.13 (n/a)	2.10 (n/a)	0.07 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`8dac9c8` — 2026-04-14 04:07:17	2.09 (n/a)	2.07 (n/a)	2.08 (n/a)	2.03 (n/a)	0.02 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`8dac9c8` — 2026-04-14 04:07:17	4.19 (n/a)	4.18 (n/a)	4.18 (n/a)	4.15 (n/a)	0.01 (n/a)	2.10 (n/a)	2.09 (n/a)	2.10 (n/a)	2.08 (n/a)	0.01 (n/a)

andrej added 8 commits April 2, 2026 11:48

Phoenix fixes

7bd7185

add pytest marker for supported device architectures

3c8e5e9

fix softmax and reformat

faab505

remove duplicate imports and annoyingly verbose comments

0fd493c

address Yiannis's comments

01226c8

undo accidental unrelated formatting changes

2ee3cb9

further cleanup, fix softmax

daeb5b8

fix context

cd8b428

andrej force-pushed the autonomous-phoenix-ci branch 2 times, most recently from 7d0a667 to 2f56779 Compare April 2, 2026 21:01

add Phoenix CI

724008e

andrej force-pushed the autonomous-phoenix-ci branch from ea973dc to 724008e Compare April 2, 2026 21:19

Merge branch 'devel' into autonomous-phoenix-ci

1bd0b20

andrej marked this pull request as ready for review April 2, 2026 22:59

andrej requested review from hunhoffe and jgmelber as code owners April 2, 2026 22:59

hunhoffe approved these changes Apr 2, 2026

View reviewed changes

andrej added 2 commits April 7, 2026 21:25

fix device detection for Krackan

c25d19e

Merge branch 'devel' into autonomous-phoenix-ci

367a7dd

andrej added 2 commits April 10, 2026 16:47

add 'docker' label back to runners

175b746

CI runner is actually Krackan, not Strix

c7d56f8

bring back archive to add in look up tables

a79954c

fix swiglus

2fbb0b1

cleanup and add aggreagte comment

168f1d1

andrej merged commit 0d542c3 into amd:devel Apr 14, 2026
5 checks passed

Conversation

andrej commented Apr 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Apr 7, 2026

IRONCLAD

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

llama_3.2_1b_prompt_1024_tokens_40

llama_3.2_1b_prompt_13_tokens_1

llama_3.2_1b_prompt_13_tokens_40

Uh oh!

github-actions bot commented Apr 10, 2026

IRONCLAD

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

llama_3.2_1b_prompt_1024_tokens_40

llama_3.2_1b_prompt_13_tokens_1

llama_3.2_1b_prompt_13_tokens_40

Uh oh!

github-actions bot commented Apr 14, 2026

IRONCLAD

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

llama_3.2_1b_prompt_1024_tokens_40

llama_3.2_1b_prompt_13_tokens_1

llama_3.2_1b_prompt_13_tokens_40

Uh oh!

github-actions bot commented Apr 14, 2026

IRONCLAD

IRONCLAD Trends

llama_3.2_1b_prompt_1024_tokens_1

llama_3.2_1b_prompt_1024_tokens_40

llama_3.2_1b_prompt_13_tokens_1

llama_3.2_1b_prompt_13_tokens_40

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

andrej commented Apr 2, 2026 •

edited

Loading