Changes between Initial Version and Version 5 of Ticket #1850


Ignore:
Timestamp:
Dec 3, 2018, 10:15:41 AM (5 years ago)
Author:
Bang Pham Huu
Comment:

Legend:

Unmodified
Added
Removed
Modified

  • Ticket #1850

    • Property Priority minor → critical
    • Property Owner changed from Bang Pham Huu to ahambasan
    • Property Status new → assigned
    • Property Summary test rasdapy with export of large array → rasdapy fails on any query resulting in more than 4MB data

  • Ticket #1850 – Description

    initial v5  
    11In #1849 an import script is attached that will import 6.6GB array in rasdaman. The query in the ticket should be checked if it works with rasdapy, with the latest rasdaman.
     2
     3The solution is http://rasdaman.org/ticket/1850#comment:4 but in C++, it needs something like this in Python: https://stackoverflow.com/a/42655487/2028440
     4
     5However, current GRPC version for rasdapy is still beta so `options` parameter does not exist. Hence, it needs to update GRPC for rasdapy.
     6
     7Rasdapy folder exists at `rasdaman/applications/rasdapy` and what need to do first is installing GRPC for python:
     8
     9{{{
     10sudo pip install grpcio-tools
     11pip install -U protobuf (version 3.6)
     12}}}
     13
     14There is a python script to generate GRPC files at `rasdapy/scripts/stub_generator.py`, however, it needs to use some built GRPC tool, so don't use this one, use this new content: https://pastebin.com/Ha2EXLbk which will generate GRPC files from above installed Python dependencies.
     15
     16After that, trying to figure out what changed from the current source code of current rasdapy using beta GRPC with new generated GRPC version.
     17
     18Finally, rasql.py should be able to run any rasql query which can be larger than 4 MB.