Error failed building wheel for fastecdsa

Asked Oct 10 ’21 12:10

1

1

1

1

1

1

1

Yes, I suppose it’s not explicitly stated in the README (which it probably should be), but the package isn’t written with Windows in mind as one of the target OSes. This is precisely because compiling the C extensions on Windows is a major pain, the main issues which you’ve touched on already (installing GMP on Windows is a nightmare and the C compiler for Python isn’t anything to write home about either).

Does MPIR expose the same functions / interface that GMP does or did you have to rewrite all the GMP library calls to MPIR calls?

MPIR was basically a drop-in replacement — just have to rename mpir.h to gmp.h and mpir.lib to gmp.lib in when you place them in your include/lib directories.

Understood. I can try to see if I can make the configuration / setup process play nice with Windows, but I can’t promise any results. Ideally it would be nice to be able to just pip install fastecdsa on Windows without any further hassle but that seems a bit unrealistic given my experience writing packages for Windows. I’ll keep the issue open until a satisfactory resolution is arrived at.

I try this steps:

1. Download from http://www.mpir.org/downloads.html MPIR-2.6.0.source.bz2, unpack to MPIR-2.6.0

2. Download from http://yasm.tortall.net/Download.html Win32 .exe (for general use on 32-bit Windows) (Not shure it needed)
   rename it to yasm.exe and put to
   C:Users%username%AppDataLocalProgramsCommonMicrosoftVisual C++ for Python9.0VCbin

3. Run cmd.exe, cd to unpacked MPIR-2.6.0 dir

4. run «C:Users%username%AppDataLocalProgramsCommonMicrosoftVisual C++ for Python9.0vcvarsall.bat»
   so set Visual C++ for Python9.0 compiler

5. cd to unpacked MPIR-2.6.0win dir

6. edit configure.bat
   add

   set ABI=32
   set VCTARGET=x86

   between :exitlp
   and :: ARCH is native ABI
   save and run configure.bat

7. run make.bat
   no errors/warnings

8. /optional/ run make.bat check -> OK
   (make tune and make speed fails)

9. run gen_mpir_h.bat

10. copy MPIR-2.6.0gmp.h to C:Users%username%AppDataLocalProgramsCommonMicrosoftVisual C++ for Python9.0VCincludegmp.h
    copy(whith rename) MPIR-2.6.0winmpir.lib C:Users%username%AppDataLocalProgramsCommonMicrosoftVisual C++ for Python9.0VClibgmp.lib

Well, first part done

as ymgve say,

I had to move all variable declarations to the start of functions

after this process
python setup.py build -> builded OK, but have linker «warning LNK4098: defaultlib ‘LIBCMT’ conflicts with use of other libs; use /NODEFAULTLIB:library»
python setup.py install
check at my project. It works!

Able to build and install but something is still going wrong —

$ python setup.py build
$ python setup.py install
$ python setup.py test
running test
Traceback (most recent call last):
  File "C:Python27librunpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "C:Python27librunpy.py", line 72, in _run_code
    exec code in run_globals
  File "C:UsersADesktopfastecdsafastecdsatest.py", line 13, in <module>
    from .ecdsa import sign, verify
  File "fastecdsaecdsa.py", line 4, in <module>
    from fastecdsa import _ecdsa
ImportError: DLL load failed: The specified module could not be found.

Continuing to investigate… (as you can probably tell I don’t do much development on the Windows platform so if I’m missing something obvious please let me know)

Probably, «setup.py install» doesn’t pack _ecdsa.pyd to egg file or egg file not yet in Libsite-packages
I will try to reproduce steps at fresh windows install to refresh my memory

I’m getting the .pyd files in the install, and indeed ipython recognizes that e.g. curvemath is an importable module, but when I try to import it the DLL load fails. I presume this is because it correctly sees that there is no underlying DLL for curvemath or _ecdsa. I have .exp and .lib and .obj files but I seem to be missing the bin/ folder that would hold the DLLs.

As I checkout my working machine, _ecdsa.dll not used at all. I have this file only at build dir and after removing this folder, scripts works as usual.
If I remove ecdsa.pyd from Libsite-packagesfastecdsa-1.6.4-py2.7-win32.egg (7zip helps) scripts fails with
File «d:Python27libsite-packagespkg_resources_init.py», line 1883, in
_extract_resource
timestamp, size = self._get_date_and_size(self.zipinfo[zip_path])
KeyError: ‘fastecdsa_ecdsa.pyd’
So, it looks like .dll have to be converted to .pyd and .pyd packed to egg

I had the same error. To fix it, just put mpir.dll from MPIR-Binary-masterdllx64Release in to the directory of package, C:Python37Libsite-packagesfastecdsa

Here is somthing interesting — I have not directory of package, .Libsite-packagesfastecdsa just egg file in .Libsite-packages
Different python build/install systems? How to check it?
Also, no mpir.dll at my machine at all. Have mpir.lib at MPIR build dir copyed to VClibgmp.lib
Attached file is build log from scratch. But, from working machine, were exist working fastecdsa pack
build.log

Here is somthing interesting — I have not directory of package, .Libsite-packagesfastecdsa just egg file in .Libsite-packages
Different python build/install systems? How to check it?
Also, no mpir.dll at my machine at all. Have mpir.lib at MPIR build dir copyed to VClibgmp.lib
Attached file is build log from scratch. But, from working machine, were exist working fastecdsa pack
build.log

You can just copy fastecdsa from egg directory to site-packages. Also I dont know about python 2.7. I’ve tested on 3+ only. My steps were:
copy gmp.h to C:Program Files (x86)Microsoft Visual Studio 14.0VCinclude
copy mpir.lib to package directory, it could be C:Python37Libsite-packagesfastecdsa or C:Python37Libsite-packagesfastecdsa-1.6.5-py3.7-win-amd64.eggfastecdsa

Hello, I encountered same problem, but solved.
I generate gmp.h, gmp.lib, gmp.def and gmp.dll from GMP.
I check what’s name of DLL lack by DependencyWalker.
So I copy libgmp-10.dll from gmp.dll.

You need to have an microsoft visual 2019 and Microsoft c++ in visual studio
to run the fastedcsa. You cannot install it without Microsoft c++. after that follow this instruction.

1. Download https://github.com/ChillMagic/MPIR-Binary
2. Download https://github.com/AntonKueltz/fastecdsa
3. rename mpir.h to gmp.h from MPIR-Binary-masterinclude and rename mpir.lib to gmp.lib from MPIR-Binary-masterlibMDx64Release
4. Copy and paste gmp.lib C:Program Files (x86)Microsoft Visual Studio2019BuildToolsVCToolsMSVC14.21.27702libx64
5. Copy and paste gmp.h C:Phyton3include
6. I don’t remember if I do this ( just put mpir.dll from MPIR-Binary-masterdllx64Release in to the directory of package, C:Python37Libsite-packagesfastecdsa ) Do it last if you have error. if not working try to rename it again to gmp.dll But I guess it’s not needed to install fastedcsa.
7. Open CMD and cd to where you put your fastecdsa E:Downloadfastecdsa-master
8. when your cmd is in the directory type: python setup.py build
9. after installation type again: python setup.py install
10. Good Luck treasure hunting.

Per @naphy0’s suggestion, i’ve (probably) gotten a build fully working by doing the following steps:

1. Install Visual Studio 2019 buildtools, and adding the C++ suite from the main menu.
2. Downloading MPIR-Library, and adding include/** to $pyinstall/include, and lib/MD/win32/Release to $pyinstall/libs
3. Add extra_link_args=["/NODEFAULTLIB:MSVCRT"] to every extension object in setup.py (since the linker was complaining about it)
4. Drink some coffee while running python setup.py build
5. Watch intensely while running python setup.py test

And all of that resulted into a successful test.

Ran 32 tests in 9.355s

OK

I pushed a commit to my fork that has the prerequisites all ready for a windows build, the only thing that needs to be installed is buildtools from here, under «Tools for Visual Studio 2019». (plus the C++ build tools)

ShadowJonathan@041d9f4

If any contributor from here can please pull on a windows machine, build, and confirm the library works as intended, please let me know. This library is required in libp2p, and currently any windows build will fail because of a fastecdsa win32 wheel missing from the pypi repo (see libp2p/py-libp2p#363).

Im currently on travel but will verify on my Windows VM as soon as I am able. Thanks for your work toward getting this package building on Windows!

I’ve also been poking around looking at automated wheel builds for windows in general, this setup has worked on my normal desktop computer (due to some other options not wanting to work before), so I am not 100% sure either about this configuration working all the time, nor if the produced library is stable enough for use.

Thanks for your work toward getting this package building on Windows!

No problem!

I’ve confirmed that building it like this only works with 32-bits python installs, anything 64-bit (amd64) fails while spitting this:

...
curveMath.c
src/curveMath.c(81): warning C4267: 'initializing': conversion from 'size_t' to 'int', possible loss of data
src/curveMath.c(115): warning C4267: 'initializing': conversion from 'size_t' to 'int', possible loss of data
src/curveMath.c(116): warning C4267: 'initializing': conversion from 'size_t' to 'int', possible loss of data
...
   Creating library buildtemp.win-amd64-3.8Releasesrccurvemath.cp38-win_amd64.lib and object buildtemp.win-amd64-3.8Releasesrccurvemath.cp38-win_amd64.exp
gmp.lib(mulmod_2expm1.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(mulmid.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(mulmid_n.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(toom42_mulmid.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(mulmod_2expp1.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(inv_divappr_q_n.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(dc_divappr_q.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(hgcd_appr.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(dc_bdiv_q.obj) : error LNK2001: unresolved external symbol __security_check_cookie
gmp.lib(hgcd_step.obj) : error LNK2001: unresolved external symbol __security_check_cookie
(etc.)

(this is after adding extra libraries under lib/MD/x64 and placing their folders first)