Reimplement Parser

[idavis]

Lexing

• Basic raw tokens
• Basic cooked tokens
• Cook pragma and annotation

Parsing

• Version Add initial AST and parser infrastructure #2148
• Include Add initial AST and parser infrastructure #2148
• pragma Add initial AST and parser infrastructure #2148
• annotation Add initial AST and parser infrastructure #2148
• Statements -
  • alias Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • array concatenation Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • assignment Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • barrier Add missing statements to QASM3 parser #2200
  • box Add missing statements to QASM3 parser #2200
  • break Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • cal Add missing statements to QASM3 parser #2200
  • calibration grammar Add missing statements to QASM3 parser #2200
  • classical decl
    • Bit, int, uint, float, angle, bool, duration, stretch Adding classical & io decls to the parser, stubbing out array decls #2165
    • Arrays Add array and measurement declaration statements #2180
    • Measurement result Add array and measurement declaration statements #2180
  • const decls Adding classical & io decls to the parser, stubbing out array decls #2165
  • continue Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • def Add subroutine, return, and gate defs, externs, and old style decls #2176
  • defcal Add missing statements to QASM3 parser #2200
  • delay Add missing statements to QASM3 parser #2200
  • end Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • expression statement Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • extern Add subroutine, return, and gate defs, externs, and old style decls #2176
  • for loops Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • gate call Add missing statements to QASM3 parser #2200
  • gate statement Add subroutine, return, and gate defs, externs, and old style decls #2176
  • gphase Add missing statements to QASM3 parser #2200
  • if statement Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • IO decls Adding classical & io decls to the parser, stubbing out array decls #2165
  • measure arrow Add missing statements to QASM3 parser #2200
  • old style decl Add subroutine, return, and gate defs, externs, and old style decls #2176
  • quantum decl Add ability to parse quantum decls and lit exprs #2160
  • reset Add missing statements to QASM3 parser #2200
  • return Add subroutine, return, and gate defs, externs, and old style decls #2176
  • switch statements QASM3 - Parse switch statements #2178
  • while loops Add ability to parse aliases, control flow statements, and expression statements to QASM3 parser #2191
  • gate def Add subroutine, return, and gate defs, externs, and old style decls #2176
• Precedence Implement Pratt Parsing for Qasm3 parser #2166
• Expressions -
  • ident Add initial AST and parser infrastructure #2148
  • unary Implement Pratt Parsing for Qasm3 parser #2166
  • binary Implement Pratt Parsing for Qasm3 parser #2166
  • literal Add ability to parse quantum decls and lit exprs #2160
  • timing literal Add missing statements to QASM3 parser #2200
  • function call Implement Pratt Parsing for Qasm3 parser #2166
  • cast Implement Pratt Parsing for Qasm3 parser #2166
  • assignment Make assignment a StmtKind #2216
  • assignment op Make assignment a StmtKind #2216
• Check for cyclic includes Cyclic and multiple include errors #2278
• Document parsing functions with grammar defs and spec notes Add grammar docstrings to QASM3 parser #2222
• Remove measurement exprs from const decl parsing. Update notes on the grammar docs as this is a spec bug. Unignore unit tests; lower and compile missing items #2272

Lowering

• Constant Evaluation for array sizes and type widths Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
• Statements -
  • alias Implement base declarations and binary expression lowering #2221
  • assignment
    • simple Implement base declarations and binary expression lowering #2221
    • indexed Implement base declarations and binary expression lowering #2221
  • barrier Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • box (unimplemented)
  • break Unignore unit tests; lower and compile missing items #2272
  • cal (unimplemented)
  • calibration grammar (unimplemented)
  • classical decls with default and literal initializers
    • Bit, int, uint, float, angle, bool, duration, stretch Implement base declarations and binary expression lowering #2221
    • creg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • qreg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • Bitarrays Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • Arrays (unimplemented)
    • Measurement result Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • classical decls with all expressions and casting Add initial semantic analysis/transform #2214
    • Bit, int, uint, float, angle, bool, duration, stretch Implement base declarations and binary expression lowering #2221
    • creg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
      • tests see bit[] tests for cases Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • qreg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
      • tests - see qubit[] tests for cases Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • Bitarrays Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • Arrays (unimplemented)
    • Measurement result Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • continue Unignore unit tests; lower and compile missing items #2272
  • def Compile gphase, gatedef, and control flow statements #2254
  • defcal (unimplemented)
  • delay (unimplemented)
  • end Compile annotations into attributes #2271
  • expression statement Implement base declarations and binary expression lowering #2221
  • extern Lower extern declaration #2274
  • for loops Lower control flow stmts in QASM3 parser #2232
  • gate call Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • broadcast (unimplemented)
  • gphase Compile gphase, gatedef, and control flow statements #2254
  • if statement Lower control flow stmts in QASM3 parser #2232
  • IO decls
  • measure arrow Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • old style decl Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • quantum decl Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • reset Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • return Compile gphase, gatedef, and control flow statements #2254
    • add cast of return value to containing function return ty Unignore unit tests; lower and compile missing items #2272
  • switch statements Lower control flow stmts in QASM3 parser #2232
  • while loops Lower control flow stmts in QASM3 parser #2232
  • gate def Compile gphase, gatedef, and control flow statements #2254
  • Return semantic error on anonymous blocks and switch statements if version is set to 3.0 as they were introduced in 3.1 Lower control flow stmts in QASM3 parser #2232
• Expressions
  • binary Adding new compiler, lowerer is now infallible #2239
  • unary Adding new compiler, lowerer is now infallible #2239
  • function call Compile gphase, gatedef, and control flow statements #2254
  • literals
    • bit, bool, float, int, uint Implement base declarations and binary expression lowering #2221
    • angle Add angle support to the new compiler #2267
    • complex Lower and compile complex binary ops #2268
    • duration Unignore unit tests; lower and compile missing items #2272
    • cast (unimplemented)
• Create qubit cleanup calls which can be conditionally added to end of program during compile, not done for fragments
• Review ignored tests from old parser Unignore unit tests; lower and compile missing items #2272
• SimulatableIntrinsic support Compile annotations into attributes #2271
  • Error when not applied to a gate or def Compile annotations into attributes #2271

Compiling

• Only set EntryPoint() attr on operation when compiling in file mode
• Statements -
  • alias (unsupported) Adding new compiler, lowerer is now infallible #2239
    • array concatenation
  • assignment Adding new compiler, lowerer is now infallible #2239
  • barrier Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • box (unimplemented)
    • pragma impls (unimplemented)
  • break (unsupported) Unignore unit tests; lower and compile missing items #2272
  • cal (unimplemented)
  • calibration grammar (unimplemented)
  • classical decls Adding new compiler, lowerer is now infallible #2239
    • Bit, int, float, angle, bool, duration, stretch Adding new compiler, lowerer is now infallible #2239
    • creg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • qreg Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
    • Arrays (unimplemented)
    • Measurement result Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • continue (unsupported) Unignore unit tests; lower and compile missing items #2272
  • def Compile gphase, gatedef, and control flow statements #2254
    • simulatable intrinsic Compile annotations into attributes #2271
  • end Compile annotations into attributes #2271
  • expression statement Adding new compiler, lowerer is now infallible #2239
  • extern (unimplemented)
  • for loops Compile gphase, gatedef, and control flow statements #2254
  • gate call Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • gphase Compile gphase, gatedef, and control flow statements #2254
  • if statement Compile gphase, gatedef, and control flow statements #2254
  • IO decls Adding new compiler, lowerer is now infallible #2239
  • measure arrow Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • old style decl Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • quantum decl Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • reset Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
  • return Compile gphase, gatedef, and control flow statements #2254
  • switch statements Compile gphase, gatedef, and control flow statements #2254
  • while loops Adding new compiler, lowerer is now infallible #2239
  • gate def Compile gphase, gatedef, and control flow statements #2254
    • simulatable intrinsic Unignore unit tests; lower and compile missing items #2272
    • gate scopes capture const variables in the outside scopes. We compiled gates to lambda operations to get this behavior. But this breaks simulatable intrinsics. Now that we have const evaluation, we can overcome this. functions and operations with const eval #2270
  • delay (unimplemented)
  • barrier Add gate calls and the AST items it depends on to the new QASM3 compiler #2246
• Expressions
  • binary Adding new compiler, lowerer is now infallible #2239
  • unary Adding new compiler, lowerer is now infallible #2239
  • function call Compile gphase, gatedef, and control flow statements #2254
  • literals
    • bit, bool, float, int, uint Implement base declarations and binary expression lowering #2221
    • angle Add angle support to the new compiler #2267
    • complex Lower and compile complex binary ops #2268
    • duration (unsupported) Adding new compiler, lowerer is now infallible #2239
    • cast (unimplemented)
• Move runtime functions in new dependency package so that they are parsed as a unit and imported by user code. This enables spans and a file name for runtime calls that get generated.

Fit and Finish

• Move Q# related semantic errors from Lowerer to Compiler
• Add better error messages to const evaluator. We can pass &mut Lowerer as an argument so that it can push semantic errors. Better error messages for const evaluator #2277
• Review compiler error messages
• Review parser error messages
• Review lexer error messages
• Delete old compiler internals that are no longer used and remove stale refs
• Benchmark parser

Postponed

• Update ast_builder calls with module names instead of old ns names
• bit x = 0; bit y = ~x; is valid QASM3, but it gets compiled to let x = Zero; let y = ~~~x; which is invalid Q# code, since the Result type in Q# doesn't support unary bitwise negation. This is the same for all other operations that bit should support, Q# Result only supports equality.
• We are currently not enforcing that qasm3 uint types must be positive, since they are compiled to Q# Int which are signed. We might need a UInt type similar to the Angle type introduced in Add angle support to the new compiler #2267 to be able to enforce this constraint.
• uint 63 bitness with 64 bigint. Separate ops for uint?
• Lower Ident as Rc<Symbol> and not as SymbolId to avoid an unnecessary SymbolTable lookup? In that way we don't even need to pass the symbol table to the compiler.
• Use the formal parameters' SymbolIds when creating the function type, so that we can give the user a better error message when they pass an argument that fails implicit casting to a function. There is a catch: we need to insert the function symbol into the symbol table before pushing the scope where the formal parameters live, but we need the SymbolIds of the formal parameters to construct the function symbol.