Scrapoxy使用docker安装错误

按照这里的说明尝试开始使用Scrapoxy时,我按照说明操作,直到步骤3A。 但是,当我使用步骤3A中指定的命令运行docker时,我得到一个不断重复的错误。 下面是错误,以及它每次出现之前的输出:

2017-11-08T22:24:51.804Z - debug: [Manager] checkInstances 2017-11-08T22:24:52.515Z - debug: [Manager] adjustInstances: required:1 / actual:0 2017-11-08T22:24:52.515Z - debug: [Manager] adjustInstances: add 1 instances 2017-11-08T22:24:52.515Z - debug: [ProviderAWSEC2] createInstances: count=1 2017-11-08T22:24:53.225Z - debug: [ProviderAWSEC2] createInstances: actualCount=0 2017-11-08T22:24:54.045Z - error: [Manager] Error: Cannot update or adjust instances: InvalidParameterValue: Value () for parameter groupId is invalid. The value cannot be empty at Request.extractError (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/services/ec2.js:50:35) at Request.callListeners (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/sequential_executor.js:105:20) at Request.emit (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/sequential_executor.js:77:10) at Request.emit (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:615:14) at Request.transition (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:22:10) at AcceptorStateMachine.runTo (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/state_machine.js:14:12) at /usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/state_machine.js:26:10 at Request.<anonymous> (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:38:9) at Request.<anonymous> (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:617:12) at Request.callListeners (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/sequential_executor.js:115:18) at Request.emit (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/sequential_executor.js:77:10) at Request.emit (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:615:14) at Request.transition (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:22:10) at AcceptorStateMachine.runTo (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/state_machine.js:14:12) at /usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/state_machine.js:26:10 at Request.<anonymous> (/usr/lib/node_modules/scrapoxy/node_modules/aws-sdk/lib/request.js:38:9) 

当我打开Scrapoxy GUI时(按照上面链接的快速入门指南中的步骤4),根据上面显示的输出,不显示任何实例。 快速入门中的第6步返回一个错误, scrapoxy: command not found

我该如何补救这个,所以我可以使用Scrapoxy? 我想将它与Python库Scrapy集成。

(如果有问题,我使用的是Ubuntu 16.04,Docker已经安装并且可以正常工作。)

你的步骤3A有什么问题

  • 参考: Scrapoxy问题NO.70
  • 确保您的AWS实例符合以下标准:
    • 它位于欧盟西部地区
    • 你已经在eu-west1地区创build了一个安全组

你的步骤3B有什么问题

  • 你没有正确安装scrapoxy。
  • 这里是一个如何在Ubuntu 16.04 LTS上安装scrapoxy的示例(在Linode上testing过)

    • 你应该首先在你的Ubuntu 16.04上安装nodejs

       sudo apt-get update curl -sL https://deb.nodesource.com/setup_9.x | sudo -E bash - sudo apt-get install -y nodejs 
    • 然后安装Make和Scrapoxy:

       sudo apt-get install -y build-essential && sudo npm install -g scrapoxy 
    • 生成configuration:

       scrapoxy init conf.json 
    • 安装你最喜欢的文本编辑器(Vim等)。
    • 编辑configuration
      • 编辑conf.json
      • commander部分,用您select的密码replacepassword
      • providers/awsec2部分中,用您的AWS凭证和参数replaceaccessKeyIdsecretAccessKeyregion
    • 开始Scrapoxy

       scrapoxy start conf.json -d 
    • 连接GUI界面:

       http://server-ip:8889