solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output #1319

rappie · 2022-08-01T15:29:03Z

Describe the issue:

Slither crashes.

Commands used:

yarn hardhat clean
slither .

Software used:
Yarn Berry (PnP), with old versions of hardhat, openzeppelin, etc.
Slither version 0.8.3
Python version 3.10.5
OS: Manjaro Linux (arch)

Error:

❯ yarn hardhat clean; slither .
'yarn hardhat compile --force' running
Compiled 2 Solidity files successfully

Traceback (most recent call last):
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 744, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 87, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 70, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/slither.py", line 95, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable
None
Error in .
Traceback (most recent call last):
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 744, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 87, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/__main__.py", line 70, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/slither.py", line 95, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/home/rappie/.local/lib/python3.10/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable

Code example to reproduce the issue:

https://github.com/rappie/slither-issue1319-environment
https://github.com/rappie/slither-issue1319-narrowed-down

Version:

0.8.3

Relevant log output:

No response

The text was updated successfully, but these errors were encountered:

0xalpharush · 2022-08-01T15:42:43Z

Can you put this on github?

rappie · 2022-08-01T15:45:41Z

Sure :)

https://github.com/rappie/slither-issue1319-environment

KholdStare · 2022-08-27T04:45:07Z

I am having same issue. Seems like the problem is here:

slither/slither/solc_parsing/slither_compilation_unit_solc.py

Lines 47 to 53 in ce9dbf6

    
           for symbol_alias in symbol_aliases: 
        
               if ( 
        
                   "foreign" in symbol_alias 
        
                   and "name" in symbol_alias["foreign"] 
        
                   and "local" in symbol_alias 
        
               ): 
        
                   original_name = symbol_alias["foreign"]["name"]

And symbol_alias["foreign"] is 2:

[{'foreign': 2, 'local': None}]

Would it be possible to define types for some of these AST nodes, so they're not just Dicts? Would be possible to catch a lot of these errors that way.

Does anyone have a link to the json AST schema? I can't seem to find it anywhere, just typescript libs like this: https://github.com/OpenZeppelin/solidity-ast .

rappie · 2022-08-30T12:48:31Z

Any progress?

I have tried narrowing it down as much as possible. It looks it has something to do with the compiler version.

With 0.5.11 it fails, with 0.8.12 it works.

You can test this easily in the repo below by editing hardhat.config.js. I've also cleaned up the code as much as possible. It's just 2 interfaces now.

https://github.com/rappie/slither-issue1319-narrowed-down

ggrieco-tob · 2022-08-30T12:57:41Z

By any chance, you tested using slither and crytic-compile from their respective master branches?

rappie · 2022-08-30T13:17:47Z

Some problem.

What I did:

First uninstall with with pip uninstall <package>
Clone repo
Run sudo python setup.py install

I did this for both slither and crytic-compile.

❯ crytic-compile --version
0.2.3
❯ slither --version
0.8.3

Here's the error again, with the new line numbers:

❯ slither .
'npx hardhat compile --force' running
Compiled 2 Solidity files successfully

contracts/IERC20.sol:1:1: Warning: Source file does not specify required compiler version! Consider adding "pragma solidity ^0.5.11;"
interface IERC20 {}
^ (Relevant source part starts here and spans across multiple lines).

contracts/InitializableERC20Detailed.sol:1:1: Warning: Source file does not specify required compiler version! Consider adding "pragma solidity ^0.5.11;"
import {IERC20} from "./IERC20.sol";
^ (Relevant source part starts here and spans across multiple lines).


Traceback (most recent call last):
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 793, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 97, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 75, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/slither.py", line 100, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable
None
Error in .
Traceback (most recent call last):
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 793, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 97, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/__main__.py", line 75, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/slither.py", line 100, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/usr/lib/python3.10/site-packages/slither_analyzer-0.8.3-py3.10.egg/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable

KholdStare · 2022-08-30T16:40:56Z

By any chance, you tested using slither and crytic-compile from their respective master branches?

The code I highlighted earlier is from the master branch. _handle_import_aliases does not work with some ASTs it looks like. There really need to be precise types for the AST in the code. I've run into several bugs that could have been avoided if the types were not just Dict.

Most likely different compiler versions output a different json AST, and slither doesn't support them.

rappie · 2022-09-02T19:12:38Z

@KholdStare Do you have any suggestions for a workaround or quickfix I can apply locally?

0xalpharush · 2022-09-02T19:27:46Z

Can you use solc 0.8.12?
#1319 (comment)

rappie · 2022-09-02T19:30:47Z

I'm not sure, it is not my own codebase. I'm trying to reproduce a known vulnerabilty and "re-find" it with echidna. I'm not sure if updating to 0.8 changes any behaviours of the system.

I might give it a try next week, but something like a small patch to slither would be preferable.

smonicas · 2022-09-02T19:45:50Z

@rappie as a temporary fix can you change in slitherbug import { IERC20 } from "@openzeppelin/contracts/token/ERC20/IERC20.sol"; to import "@openzeppelin/contracts/token/ERC20/IERC20.sol"; it should work with 0.5.11

rappie · 2022-09-02T21:41:28Z

Awesome! This indeed works.

Thanks 😄

KholdStare · 2022-10-05T20:53:05Z

@smonicas @0xalpharush Hi, any acknowledgement about what I pointed out above as the bug?
#1319 (comment)

I think a lot of issues would be fixed if there were proper types for the AST. We currently cannot use Slither because of these kinds of issues - we don't want to be bending over backwards changing our code, just so that slither doesn't crash on it. I and my team can help out making fixes, but not if our comments are basically ignored.

0xalpharush · 2022-10-05T21:01:31Z

I have labeled this issue as a bug. Yes, having a typed AST would be nice; however, it is not our highest priority. We do our best to keep up with breaking changes in Solidity while maintaining backwards compatibility. There was an effort to separate the legacy and compact parsers, but it was not completed (#627). I will try to fix this specific issue soon.

KholdStare · 2022-10-06T02:48:42Z

@0xalpharush Thanks for the reply. I think Slither's core strength is in the detectors etc. Right now it is hindered by the parsing stage which is just a necessary step to get to the detectors. Without the parsing stage, it renders the rest of it useless, so paradoxically IMHO it should be of high priority to do parsing properly.

Taking a step back, I think there should be standalone library specifically handling AST parsing and having a single representation for all versions (not necessarily maintained by you, just in general). Slither could then use it and not have to worry about parsing. Does such a project exist in python land? It exists in typescript land: https://github.com/OpenZeppelin/solidity-ast . Any insights into who can start such a project?

Aminechakr · 2022-10-22T11:44:22Z

Hello, are there any updates on this issue, this bug also blocks us, we can't run CI solidity slighter audit jobs anymore.

slither . --truffle-build-directory build/ results with :

> Compiled successfully using:
   - solc: 0.5.16+commit.9c3226ce.Emscripten.clang

Traceback (most recent call last):
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 826, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 97, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 75, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/home/amine/.local/lib/python3.9/site-packages/slither/slither.py", line 102, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable
Error in .
Traceback (most recent call last):
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 826, in main_impl
    ) = process_all(filename, args, detector_classes, printer_classes)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 97, in process_all
    ) = process_single(compilation, args, detector_classes, printer_classes)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/__main__.py", line 75, in process_single
    slither = Slither(target, ast_format=ast, **vars(args))
  File "/home/amine/.local/lib/python3.9/site-packages/slither/slither.py", line 102, in __init__
    parser.parse_top_level_from_loaded_json(ast, path)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 238, in parse_top_level_from_loaded_json
    _handle_import_aliases(symbol_aliases, import_directive, scope)
  File "/home/amine/.local/lib/python3.9/site-packages/slither/solc_parsing/slither_compilation_unit_solc.py", line 50, in _handle_import_aliases
    and "name" in symbol_alias["foreign"]
TypeError: argument of type 'int' is not iterable

0xalpharush · 2022-12-12T19:41:20Z

Based off of this issue, the AST for solc 0.5.12 is completely missing the foreign info. I don't see a workaround other than upgrading the a version of solc that contains the bug fix.

SheldonHolmgren · 2023-01-01T12:15:10Z

Thanks for pinpointing it to the solc bug. Looks like the earliest solc version in which it was fixed is 0.6.0, so unfortunately upgrading solc might require some changes in the solidity code base. The following patch applied to slither seems to work around the solc bug:

diff --git a/slither/solc_parsing/slither_compilation_unit_solc.py b/slither/solc_parsing/slither_compilation_unit_solc.py
index d12bda1b..67614e84 100644
--- a/slither/solc_parsing/slither_compilation_unit_solc.py
+++ b/slither/solc_parsing/slither_compilation_unit_solc.py
@@ -47,6 +47,7 @@ def _handle_import_aliases(
     for symbol_alias in symbol_aliases:
         if (
             "foreign" in symbol_alias
+            and not isinstance(symbol_alias["foreign"], int)
             and "name" in symbol_alias["foreign"]
             and "local" in symbol_alias
         ):

If my reading is correct, this should do the right thing as long as the problematic imports are of the format

import {Foo} from "bar.sol";

and not

import {Foo as AnotherName} from "bar.sol";

(Of course, I'm not suggesting this should be applied to slither globally, since that would probably break the latter kind of imports.)

0xalpharush · 2023-01-11T17:58:19Z

We add a better error message and support import {Foo} from "bar.sol"; style imports for these older solc versions

rappie added the bug-candidate Bugs reports that are not yet confirmed label Aug 1, 2022

0xalpharush added bug Something isn't working and removed bug-candidate Bugs reports that are not yet confirmed labels Sep 3, 2022

0xalpharush added the High Priority label Oct 5, 2022

ZeroEkkusu mentioned this issue Nov 23, 2022

mardizzone/pos-944 Snyk integration maticnetwork/genesis-contracts#55

Open

13 tasks

0xalpharush added wontfix This will not be worked on and removed bug Something isn't working High Priority labels Dec 12, 2022

0xalpharush changed the title ~~[Bug-Candidate]: TypeError: argument of type 'int' is not iterable~~ solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output Dec 12, 2022

0xalpharush mentioned this issue Jan 3, 2023

Handle malformed alias solc<0.6.0 #1547

Merged

bayological mentioned this issue Jan 9, 2023

Add Slither static analysis to CI workflow mento-protocol/mento-core#95

Closed

1 task

0xalpharush mentioned this issue Jan 10, 2023

Asks me to upgrade to solc 0.6.0 version when I already have it #1578

Closed

0xalpharush closed this as completed Jan 11, 2023

bowd mentioned this issue Jan 26, 2023

feat: add workflow for slither mento-protocol/mento-core#101

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output #1319

solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output #1319

rappie commented Aug 1, 2022 •

edited

Loading

0xalpharush commented Aug 1, 2022

rappie commented Aug 1, 2022 •

edited

Loading

KholdStare commented Aug 27, 2022 •

edited

Loading

rappie commented Aug 30, 2022 •

edited

Loading

ggrieco-tob commented Aug 30, 2022

rappie commented Aug 30, 2022

KholdStare commented Aug 30, 2022 •

edited

Loading

rappie commented Sep 2, 2022

0xalpharush commented Sep 2, 2022

rappie commented Sep 2, 2022

smonicas commented Sep 2, 2022

rappie commented Sep 2, 2022

KholdStare commented Oct 5, 2022 •

edited

Loading

0xalpharush commented Oct 5, 2022

KholdStare commented Oct 6, 2022 •

edited

Loading

Aminechakr commented Oct 22, 2022 •

edited

Loading

0xalpharush commented Dec 12, 2022

SheldonHolmgren commented Jan 1, 2023

0xalpharush commented Jan 11, 2023

solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output #1319

solc 0.5.12 causes TypeError: argument of type 'int' is not iterable due to bug in AST output #1319

Comments

rappie commented Aug 1, 2022 • edited Loading

Describe the issue:

Code example to reproduce the issue:

Version:

Relevant log output:

0xalpharush commented Aug 1, 2022

rappie commented Aug 1, 2022 • edited Loading

KholdStare commented Aug 27, 2022 • edited Loading

rappie commented Aug 30, 2022 • edited Loading

ggrieco-tob commented Aug 30, 2022

rappie commented Aug 30, 2022

KholdStare commented Aug 30, 2022 • edited Loading

rappie commented Sep 2, 2022

0xalpharush commented Sep 2, 2022

rappie commented Sep 2, 2022

smonicas commented Sep 2, 2022

rappie commented Sep 2, 2022

KholdStare commented Oct 5, 2022 • edited Loading

0xalpharush commented Oct 5, 2022

KholdStare commented Oct 6, 2022 • edited Loading

Aminechakr commented Oct 22, 2022 • edited Loading

0xalpharush commented Dec 12, 2022

SheldonHolmgren commented Jan 1, 2023

0xalpharush commented Jan 11, 2023

rappie commented Aug 1, 2022 •

edited

Loading

rappie commented Aug 1, 2022 •

edited

Loading

KholdStare commented Aug 27, 2022 •

edited

Loading

rappie commented Aug 30, 2022 •

edited

Loading

KholdStare commented Aug 30, 2022 •

edited

Loading

KholdStare commented Oct 5, 2022 •

edited

Loading

KholdStare commented Oct 6, 2022 •

edited

Loading

Aminechakr commented Oct 22, 2022 •

edited

Loading