Opened 5 years ago

Closed 5 years ago

#2152 closed defect (invalid)

installer: install.sh fails

Reported by: Dimitar Misev Owned by: Bang Pham Huu
Priority: major Milestone: 10.0
Component: build system Version: 9.8
Keywords: Cc: Peter Baumann
Complexity: Medium

Description

running install.sh for an update I shows this error (only last lines)

Checking if installer needs to be updated...
Installer is at latest version.
An unexpected error has occured. Please provide the file
/tmp/rasdaman.install.log and the below information to a developer:
[Errno 2] No such file or directory: '/tmp/profiles/installer/default.toml'
Traceback (most recent call last):
  File "/tmp//rasdaman-installer/main.py", line 99, in main
    profile.parse_profile(os.path.abspath(sys.argv[1]))
  File "/tmp/rasdaman-installer/profile/profile.py", line 133, in parse_profile
    with open(path_to_profile) as toml_profile_file:
IOError: [Errno 2] No such file or directory: '/tmp/profiles/installer/default.toml'
ERROR: The installer returned an error code. The installation might not be valid.

Change History (6)

comment:1 by Dimitar Misev, 5 years ago

Resolution: invalid
Status: newclosed

I cannot reproduce the issue. The file /tmp//rasdaman-installer/profiles/installer/default.toml exists for me (and I made sure to remove /tmp/rasdaman-installer just in case before running the below).

$ wget http://download.rasdaman.org/installer/install.sh
$ bash install.sh 
Using default profile: /tmp//rasdaman-installer/profiles/installer/default.toml
Checking if installer needs to be updated...
Installer is at latest version.

Select the level of interactivity during the installation:
 0 - automated, do not ask any questions
 1 - critical, ask before any potentially hard to reverse changes
 2 - normal, ask before typically safe changes as well, reverting is possible
 3 - trivial, verify every possible system change
 [0/1/2/3] (Default: 1) > 3

Review the installation settings:

Install path: /opt/rasdaman/
User: rasdaman
...

comment:2 by Peter Baumann, 5 years ago

Resolution: invalid
Status: closedreopened

…so what can I do in this case? Note that I have purged /opt/rasdaman and the download directory before, so all source code got downloaded afresh.

Re versions, I get:

$ cd /opt/rasdaman
$ find . -name version.h
./source/version.h
./build/version.h
./include/version.h
$ cat ./source/version.h
#define RMANVERSION "v9.3.2-g126fcde"
#define GCCVERSION "gcc (Ubuntu 4.8.4-2ubuntu1~14.04.3) 4.8.4"
#define GCCTARGET "x86_64-linux-gnu"
$ cat ./build/version.h
#define RMANVERSION "9.5.0"
#define GCCVERSION "c++ (Ubuntu 4.8.4-2ubuntu1~14.04.3) 4.8.4"
#define GCCTARGET "x86_64-linux-gnu"
$ cat ./include/version.h
#define RMANVERSION "9.8.0"
#define GCCVERSION "c++ (Ubuntu 7.4.0-1ubuntu1~18.04.1) 7.4.0"
#define GCCTARGET "x86_64-linux-gnu"
$ gcc --version
gcc (Ubuntu 7.4.0-1ubuntu1~18.04.1) 7.4.0

Concerning the missing file, actually the whole directory /tmp/rasdaman-installer is not created.

Last edited 5 years ago by Peter Baumann (previous) (diff)

comment:3 by Dimitar Misev, 5 years ago

Ok can you try this and post the output?

$ wget http://download.rasdaman.org/installer/install.sh
$ bash -x install.sh

comment:4 by Peter Baumann, 5 years ago

here it comes, cwd=/home/rasdaman; note the (new) error on Google download :(

$ mkdir tmp
$ cd tmp
$ wget http://download.rasdaman.org/installer/install.sh
--2019-08-05 16:28:26--  http://download.rasdaman.org/installer/install.sh
Resolving download.rasdaman.org (download.rasdaman.org)... 212.201.49.173
Connecting to download.rasdaman.org (download.rasdaman.org)|212.201.49.173|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5223 (5,1K) [text/x-sh]
Saving to: ‘install.sh’

install.sh                             100%[=========================================================================>]   5,10K  --.-KB/s    in 0s      

2019-08-05 16:28:27 (525 MB/s) - ‘install.sh’ saved [5223/5223]

$ bash -x install.sh
+ trap cleanup EXIT
+ read_args
+ local PROFILE_PATH_OPTION=
+ local DWD_DIR_OPTION=/tmp/
+ local DWD_ONLY_OPTION=false
+ [[ 0 > 0 ]]
+ readonly ONLY_DOWNLOAD=false
+ ONLY_DOWNLOAD=false
+ readonly INSTALLER_DOWNLOAD_PARENT_DIRECTORY=/tmp/
+ INSTALLER_DOWNLOAD_PARENT_DIRECTORY=/tmp/
+ readonly RASDAMAN_INSTALLER_NAME=rasdaman-installer
+ RASDAMAN_INSTALLER_NAME=rasdaman-installer
+ readonly INSTALLER_URL=http://download.rasdaman.org/installer/rasdaman-installer.zip
+ INSTALLER_URL=http://download.rasdaman.org/installer/rasdaman-installer.zip
+ readonly INSTALLER_LOCATION=/tmp//rasdaman-installer
+ INSTALLER_LOCATION=/tmp//rasdaman-installer
+ readonly INSTALLER_ARCHIVE_DOWNLOAD_LOCATION=/tmp//rasdaman-installer.zip
+ INSTALLER_ARCHIVE_DOWNLOAD_LOCATION=/tmp//rasdaman-installer.zip
+ readonly INSTALLER_PYTHON_MAIN=/tmp//rasdaman-installer/main.py
+ INSTALLER_PYTHON_MAIN=/tmp//rasdaman-installer/main.py
+ '[' -n '' ']'
+ check_deps
+ wget --help
+ check_error 0 'wget not found, please install it first.'
+ '[' 0 -ne 0 ']'
+ unzip
+ check_error 0 'unzip not found, please install it first.'
+ '[' 0 -ne 0 ']'
+ '[' 0 -eq 0 ']'
+ INSTALLER_PROFILE=/tmp//rasdaman-installer/profiles/installer/default.toml
+ echo 'Using default profile: /tmp//rasdaman-installer/profiles/installer/default.toml'
Using default profile: /tmp//rasdaman-installer/profiles/installer/default.toml
+ download_installer /tmp/ http://download.rasdaman.org/installer/rasdaman-installer.zip /tmp//rasdaman-installer.zip
+ cd /tmp/
+ check_error 0 'The download path '\''/tmp/'\'' is not valid.'
+ '[' 0 -ne 0 ']'
+ wget http://download.rasdaman.org/installer/rasdaman-installer.zip -q -O /tmp//rasdaman-installer.zip
+ check_error 0 'Could not download the installer.'
+ '[' 0 -ne 0 ']'
+ unzip -o /tmp//rasdaman-installer.zip
+ check_error 0 'Could not unzip the installer.'
+ '[' 0 -ne 0 ']'
+ '[' false = true ']'
+ run_installer /tmp//rasdaman-installer/main.py /tmp//rasdaman-installer/profiles/installer/default.toml
+ sudo -l
[sudo] password for rasdaman: 
+ check_error 0 'You need to be able to run the sudo command in order to continue the installation. Check your sudo rights using sudo -l'
+ '[' 0 -ne 0 ']'
+ sudo python --version
+ check_error 0 'You need to install python and make it available in the PATH for the root user.'
+ '[' 0 -ne 0 ']'
+ sudo python /tmp//rasdaman-installer/main.py /tmp//rasdaman-installer/profiles/installer/default.toml
Checking if installer needs to be updated...
Installer is at latest version.

Select the level of interactivity during the installation:
 0 - automated, do not ask any questions
 1 - critical, ask before any potentially hard to reverse changes
 2 - normal, ask before typically safe changes as well, reverting is possible
 3 - trivial, verify every possible system change
 [0/1/2/3] (Default: 1) > 0

Review the installation settings:

Install path: /opt/rasdaman/
User: rasdaman
Database: sqlite, /opt/rasdaman/data/
Repository: git://rasdaman.org/rasdaman.git
Version: master
Debug: False
Protocol: rasnet
Install webapps: True
  Petascopedb url: jdbc:postgresql://localhost:5432/petascopedb
  Petascopedb user: petauser
  Deployment: external
  Webapps path: /var/lib/tomcat8/webapps
  Webapps logs: /var/log/tomcat8
Insert demos: True
Run systemtest: False
Generate package: False
Validating system...
System was validated.
Installing third party dependencies on Ubuntu 18.04...
Installing packages: make libtool gawk autoconf automake bison flex git g++ unzip libpng-dev libjpeg-dev libboost-filesystem-dev libboost-thread-dev libboost-system-dev libtiff-dev libgdal-dev zlib1g-dev libffi-dev libboost-dev libnetcdf-dev libedit-dev libreadline-dev libsqlite3-dev libgrib2c-dev curl libdw-dev libssl1.0-dev libeccodes-dev openjdk-8-jdk maven ant libgdal-java cmake ccache postgresql postgresql-contrib sqlite3 zlib1g gdal-bin debianutils python-setuptools python-dateutil python-lxml python-pip python-gdal libnetcdf-dev libedit-dev libreadline-dev libdw1 python-netcdf4 libssl1.0.0 libeccodes0 python-glob2 tomcat8 openjdk-8-jre libgdal-java
retrying command...
retrying command...
An error has occured while executing this command: apt-get update.Check the log at /tmp/rasdaman.install.log for more details.
Preview of the error:
 Return code: 100
 Stderr: E: Repository 'http://dl.google.com/linux/chrome/deb stable Release' changed its 'Origin' value from 'Google, Inc.' to 'Google LLC'
W: GPG error: https://qgis.org/debian bionic InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY CAEB3DC3BDF7FB45
E: The repository 'https://qgis.org/debian bionic InRelease' is not signed.
E: Repository 'http://ppa.launchpad.net/webupd8team/java/ubuntu bionic InRelease' changed its 'Label' value from 'Oracle Java (JDK) 8 / 9 Installer PPA' to 'Oracle Java (JDK) 8 Installer PPA (DISCONTINUED)'

 Stdout:Ign:1 http://dl.google.com/linux/chrome/deb stable InRelease
Hit:2 http://de.archive.ubuntu.com/ubuntu bionic InRelease
Hit:3 http://archive.canonical.com/ubuntu bionic InRelease
Get:4 http://dl.google.com/linux/chrome/deb stable Release [943 B]
Hit:5 http://ppa.launchpad.net/bluetooth/bluez/ubuntu bionic InRelease
Hit:6 http://security.ubuntu.com/ubuntu bionic-security InRelease
Get:7 http://dl.google.com/linux/chrome/deb stable Release.gpg [819 B]
Get:8 https://qgis.org/debian bionic InRelease [3.344 B]
Hit:9 https://repo.skype.com/deb stable InRelease
Get:10 http://ppa.launchpad.net/webupd8team/java/ubuntu bionic InRelease [15,4 kB]
Err:8 https://qgis.org/debian bionic InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY CAEB3DC3BDF7FB45
Reading package lists...

+ check_error 1 'The installer returned an error code. The installation might not be valid.'
+ '[' 1 -ne 0 ']'
+ echo 'ERROR: The installer returned an error code. The installation might not be valid.'
ERROR: The installer returned an error code. The installation might not be valid.
+ exit 1
+ cleanup
+ '[' false '!=' true ']'
+ rm -rf /tmp//rasdaman-installer
+ rm -f /tmp//rasdaman-installer.zip

comment:5 by Dimitar Misev, 5 years ago

Ok but now it's an entirely different error. I think previously you used an outdated install.sh which had a bug.

This is an error in your apt-get repos configuration. If you do apt-get update on your machine you'll probably get it as well.

The main problems are these repos, somewhere in your /etc/apt/sources.list or some file in /etc/apt/sources.list.d/

E: The repository 'https://qgis.org/debian bionic InRelease' is not signed.
E: Repository 'http://ppa.launchpad.net/webupd8team/java/ubuntu bionic InRelease' changed its 'Label' value from 'Oracle Java (JDK) 8 / 9 Installer PPA' to 'Oracle Java (JDK) 8 Installer PPA (DISCONTINUED)'

comment:6 by Vlad Merticariu, 5 years ago

Resolution: invalid
Status: reopenedclosed
Note: See TracTickets for help on using tickets.