Fix portia_server

[milahu]

this PR is abandoned in favor of Gerapy

fix #883 #920 #913 #907 #903 #902 #895 #877 #842 #812 #811 #790 #760 #742 ...

todo

• fix portia_server
  • bump version from 2.0.8 to 2.1.0
• fix slybot (at least the build is working, may produce runtime errors)
  • fix some snapshot tests
• fix portiaui
• fix slyd
• support frames frame and iframe support in Portia #494

related
scrapinghub/portia2code#12
scrapy/scrapely#122

[Clarence-G]

Thank you very much for your contribution. I recently strongly needed a working version. How to compile and run the branch?

[milahu]

im using nix for packaging, as it gives great flexibility.
when you're on linux, nix is easy to install ... on windows, you need WSL
save the build file portia-server.nix and run

nix-build -E 'with import <nixpkgs> { }; callPackage ./portia-server.nix { }'
./result/bin/portia-server --help

note, this branch is a work in progress

the python code is "basically working"

the javascript code is on my todo list, something with this,
probably npmlock2nix as portiaui is using the npm lockfile package-lock.json
ideally update dependencies and fix API changes ... yay

[Clarence-G]

@milahu Thanks for your explanation. I have installed nix on WSL. But I couldn't find the build file portia-server.nix. So how to wrtie the build file?

[milahu]

I have installed nix on WSL

cool. is it working? ^^

nix-shell -p cowsay --run 'cowsay "yepp, nix seems to work"'

I couldn't find the build file portia-server.nix

see my first post, but thats an old version

how good is your javascript and python?
if you want to help, i can share my current nix build files
so you can (hopefully) reproduce my development environment

basically im just printing variables and googling for error messages ...

[milahu]

slowly getting there ...

google captcha throws Frames are not supported by Portia → #494

[milahu]

abandoning this PR in favor of Gerapy