Skip to content

Fix crash in CosetLeadersMatFFE#6326

Open
fingolfin wants to merge 1 commit intomasterfrom
codex/CosetLeadersMatFFE-crash
Open

Fix crash in CosetLeadersMatFFE#6326
fingolfin wants to merge 1 commit intomasterfrom
codex/CosetLeadersMatFFE-crash

Conversation

@fingolfin
Copy link
Copy Markdown
Member

Reject matrices with dependent rows before building the internal search tables for CosetLeadersMatFFE. This avoids a crash in the 8-bit path and restores correct behaviour for square full-rank inputs.

AI assistance: Codex reproduced the crash, traced it to the internal row-independence assumption, added a regression test, and prepared the fix.

Co-authored-by: Codex codex@openai.com

@fingolfin fingolfin added kind: bug Issues describing general bugs, and PRs fixing them kind: bug: crash Issues describing bugs that cause GAP to crash, and PRs fixing them (used for release notes) topic: library release notes: use title For PRs: the title of this PR is suitable for direct use in the release notes labels Apr 16, 2026
@fingolfin fingolfin force-pushed the codex/CosetLeadersMatFFE-crash branch from 13e67d6 to 29dd0f5 Compare April 17, 2026 20:58
Reject matrices with dependent rows before building the
internal search tables for CosetLeadersMatFFE. This avoids
a crash in the 8-bit path and restores correct behaviour
for square full-rank inputs.

AI assistance: Codex reproduced the crash, traced it to
the internal row-independence assumption, added a
regression test, and prepared the fix.

Co-authored-by: Codex <codex@openai.com>
@fingolfin fingolfin force-pushed the codex/CosetLeadersMatFFE-crash branch from 29dd0f5 to 1653d43 Compare April 17, 2026 21:00
Comment thread lib/listcoef.gi
tofind := q^m;
t := TransposedMat(mat);
vl := [];
vl[m+1] := false;
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should use EmptyPlist.

Also later on Add(vl[i],false); seems also fishy.

And perhaps the C layer could also have some better argument validation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind: bug: crash Issues describing bugs that cause GAP to crash, and PRs fixing them (used for release notes) kind: bug Issues describing general bugs, and PRs fixing them release notes: use title For PRs: the title of this PR is suitable for direct use in the release notes topic: library

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant