Opened 8 years ago

Closed 8 years ago

#1060 closed defect (fixed)

Common interface for extracting specific structures from decode files

Reported by: Alex Dumitru Owned by: Alex Dumitru
Priority: major Milestone: 9.3
Component: conversion Version: development
Keywords: Cc: Vlad Merticariu, Peter Baumann
Complexity: Medium

Description (last modified by Dimitar Misev)

Rasdaman should allow for a common syntax in the decode function that allows to select certain subset structures from the file (e.g. variables in NetCDF, bands in GDAL, fields in GRIB etc).
Some basic example:

select decode(mycol, "NetCDF", "variables=[myVar1, myVar2]") from mycol

Relatively common parameters:

  1. dataset subset: variable names, message ids, band ids: can be considered a single category. I'm not sure if GRIB's message ids belongs here actually, as we import them as a dimension rather than bands in rasdaman.
  2. spatial subset: lat/lon, x/y/t, etc. subsets, especially relevant for insitu
  3. x/y transpose: indicate if x/y should be transposed or is it not relevant (comes up in netCDF and GRIB and has a performance penalty at both decode and encode)

Any others?

Change History (5)

comment:1 by Dimitar Misev, 8 years ago

Component: undecidedconversion
Milestone: 9.1.x

inv_netcdf supports specifying variable names for example, see #81

comment:2 by Dimitar Misev, 8 years ago

Cc: Vlad Merticariu Peter Baumann added; George Merticariu removed

Indeed we should try to consolidate a common interface for decode:

  1. dataset subset: variable names, message ids, band ids: can be considered a single category. I'm not sure if GRIB's message ids belongs here actually, as we import them as a dimension rather than bands in rasdaman.
  2. spatial subset: lat/lon, x/y/t, etc. subsets, especially relevant for insitu
  3. x/y transpose: indicate if x/y should be transposed or is it not relevant (comes up in netCDF and GRIB and has a performance penalty at both decode and encode)

Any other parameters?

Last edited 8 years ago by Dimitar Misev (previous) (diff)

comment:3 by Dimitar Misev, 8 years ago

Description: modified (diff)
Milestone: 9.1.x9.3

comment:4 by Dimitar Misev, 8 years ago

Fixed, details at wiki:CommonFormatsInterface

comment:5 by Dimitar Misev, 8 years ago

Resolution: fixed
Status: newclosed
Note: See TracTickets for help on using tickets.