Logs Viewer

Log File: geona_hyperspectral.log

2023-12-08 14:59:21,713 INFO Pre-flight checks...
2023-12-08 14:59:21,713 INFO Running time check
2023-12-08 14:59:21,736 INFO NTP server datetime : Fri Dec 8 14:59:21 2023
2023-12-08 14:59:21,737 INFO System datetime     : Fri Dec 08 14:59:21 2023
2023-12-08 14:59:21,739 INFO Offset in seconds   : -0.736935
2023-12-08 14:59:21,740 INFO Passed
2023-12-08 14:59:21,740 INFO ------
2023-12-08 14:59:21,740 INFO Running version check
2023-12-08 14:59:21,740 INFO Geona Hyperspectral version 0.11.3
2023-12-08 14:59:21,791 INFO Passed
2023-12-08 14:59:21,791 INFO ------
2023-12-08 14:59:21,791 INFO Running filesystem check
2023-12-08 14:59:21,791 INFO Available disk space in '/opt/geona/data': 684GB
2023-12-08 14:59:21,791 INFO Passed
2023-12-08 14:59:21,791 INFO ------
2023-12-08 14:59:21,792 INFO Launching Geona Hyperspectral Dashboard
2023-12-08 15:00:35,950 INFO Validation for Job ID '7fb9b358' passed
2023-12-08 15:00:35,950 INFO saving config file as: '/opt/geona/data/configs/geona_hyperspectral_config_afx17_2023-12-08-150035.ini'
2023-12-08 15:00:35,951 INFO Loading config from file: '/opt/geona/data/configs/geona_hyperspectral_config_afx17_2023-12-08-150035.ini'
2023-12-08 15:00:35,952 INFO Validation for Job ID '7fb9b358' passed
2023-12-08 15:00:35,952 INFO Valid config returned
2023-12-08 15:00:35,952 INFO Processing Started....
2023-12-08 15:00:35,953 INFO Processing Job ID: 7fb9b358
2023-12-08 15:00:35,953 INFO Creating workspace directory in '/opt/geona/data/workspace/7fb9b358'
2023-12-08 15:00:35,953 INFO Copying configuration file to workspace: '/opt/geona/data/workspace/7fb9b358/config_7fb9b358.ini'
2023-12-08 15:00:35,955 INFO Creating job status file: '/opt/geona/data/workspace/7fb9b358/status_7fb9b358.json'
2023-12-08 15:00:35,955 INFO Step 2 of 16 - LICENCE_CHECK: Checking for a valid licence file
2023-12-08 15:00:35,955 INFO Requesting licence
2023-12-08 15:00:36,088 INFO Licence owner    : PML Applications 
2023-12-08 15:00:36,100 INFO NTP server time  : Fri Dec 8 15:00:36 2023 
2023-12-08 15:00:36,100 INFO Not valid before : Thu Dec 7 15:00:36 2023 
2023-12-08 15:00:36,101 INFO Not valid after  : Sun Jan 7 15:00:36 2024 
2023-12-08 15:00:36,111 INFO Step 3 of 16 - WRITE_TEST: Testing write permissions on the output location
2023-12-08 15:00:36,111 INFO Testing local write permission...
2023-12-08 15:00:36,112 INFO Passed: target destination is writable
2023-12-08 15:00:36,112 INFO Step 4 of 16 - DOWNLOAD_INPUTS: Gathering input files to the workspace directory from their original location
2023-12-08 15:00:36,112 INFO '/opt/geona/data/input/day2_f3_20200924_080555/capture/day2_f3_20200924_080555.raw' symlinked to workspace
2023-12-08 15:00:36,112 INFO '/opt/geona/data/input/day2_f3_20200924_080555/capture/day2_f3_20200924_080555.hdr' symlinked to workspace
2023-12-08 15:00:36,112 INFO '/opt/geona/data/input/day2_f3_20200924_080555/capture/day2_f3_20200924_080555.nav' symlinked to workspace
2023-12-08 15:00:36,112 INFO '/opt/geona/data/input/day2_f3_20200924_080555/capture/day2_f3_20200924_080555.log' symlinked to workspace
2023-12-08 15:00:36,113 INFO '/opt/geona/data/input/day2_f3_20200924_080555/calibrations/radiometric/day2_f3_20200924_080555.cal' symlinked to workspace
2023-12-08 15:00:36,113 INFO '/opt/geona/data/input/day2_f3_20200924_080555/calibrations/radiometric/day2_f3_20200924_080555.hdr' symlinked to workspace
2023-12-08 15:00:36,113 INFO '/opt/geona/data/input/Keskuspuisto-2009/Parameters/FOV_AFX17_sn2100014_20200429_1b.txt' symlinked to workspace
2023-12-08 15:00:36,113 INFO Step 5 of 16 - CONVERT_NAV_FORMAT: Converting navigation data to a suitable format
2023-12-08 15:00:36,113 INFO Step 6 of 16 - CONVERT_VIEW_VECTOR_FORMAT: Converting view vectors to binary format
2023-12-08 15:00:36,130 INFO Binning value read from hdr file as: ['1']
2023-12-08 15:00:36,144 INFO Step 7 of 16 - CALIBRATION: Running calibration operation
2023-12-08 15:00:36,145 WARNING No bad pixel file supplied with calibration, assuming no bad pixels
2023-12-08 15:00:36,157 INFO Reading command line and sorting options.
2023-12-08 15:00:36,157 INFO Operating system: Linux Release: 5.15.0-86-generic Version: #96~20.04.1-Ubuntu SMP Thu Sep 21 13:23:37 UTC 2023
2023-12-08 15:00:36,157 INFO Machine information: x86_64 Host name: 2ced290e82a3 Domain name: (none)
2023-12-08 15:00:36,157 INFO Sensor has no FODIS region defined.
2023-12-08 15:00:36,157 INFO Log file exists /opt/geona/data/workspace/7fb9b358/capture/day2_f3_20200924_080555.log - will use this for finding dropped scans.
2023-12-08 15:00:36,157 INFO AFX17 sensor detected - created AFX17 object.
2023-12-08 15:00:36,157 INFO Sensor has no FODIS region defined.
2023-12-08 15:00:36,157 INFO Log file exists /opt/geona/data/workspace/7fb9b358/capture/day2_f3_20200924_080555.log - will use this for finding dropped scans.
2023-12-08 15:00:36,157 INFO Total number of missing frames are: 0
2023-12-08 15:00:36,158 INFO Reading calibration file: /opt/geona/data/workspace/7fb9b358/calibration/day2_f3_20200924_080555.cal
2023-12-08 15:00:36,158 INFO ---------- WARNING ----------
2023-12-08 15:00:36,158 INFO Note that integration time of calibration file is ignored - assume it relates to a value of 1.0.
2023-12-08 15:00:36,158 INFO ---------- ------- ----------
2023-12-08 15:00:36,158 INFO Calibration file contains:  640 samples, 1 lines and 112 bands.
2023-12-08 15:00:36,158 INFO Checking calibration wavelengths for subsensor: 0
2023-12-08 15:00:36,160 INFO There are 112 bands in (binned) calibration file whose centre wavelengths agree with the raw image.
2023-12-08 15:00:36,160 INFO Starting dark frame analysis...
2023-12-08 15:00:36,439 INFO Finished dark frame analysis for sensor index 0 ...
2023-12-08 15:00:36,439 INFO Will read in bad pixels from: /opt/geona/data/workspace/7fb9b358/calibration/day2_f3_20200924_080555.bad
2023-12-08 15:00:36,439 INFO Detected ARSF calibrated bad pixel file.
2023-12-08 15:00:36,439 INFO Will create method descriptors: 7
2023-12-08 15:00:36,439 INFO methodA = ConstantLightInconstantResponse. Data for given pixel varies greater than given threshold. Thresholds=./bad_pixels_tools_and_conf/nofilter-swir: 10.0, ./bad_pixels_tools_and_conf/nofilter-vnir: 10.0
2023-12-08 15:00:36,439 INFO methodB = DeviationFromSpectralAndSpatialNeighbours. Data for given pixel varies from spectral and spatial neighbours greater than given threshold. (spectral, spatial)=./bad_pixels_tools_and_conf/nofilter-swir: (3, 10), ./bad_pixels_tools_and_conf/nofilter-vnir: (3, 10). Threshold=./bad_pixels_tools_and_conf/nofilter-swir: 20.0, ./bad_pixels_tools_and_conf/nofilter-vnir: 10.0
2023-12-08 15:00:36,439 INFO methodC = LinearInputNonLinearResponse. Correlation of pixel integration time against data value is less than given threshold. Threshold=./bad_pixels_tools_and_conf/nofilter-swir: 0.9825, ./bad_pixels_tools_and_conf/nofilter-vnir: 0.9825
2023-12-08 15:00:36,440 INFO methodD = RapidSaturation. Correlation of pixel integration time against data value varies from spectral and spatial neighbours greater than given threshold. ./bad_pixels_tools_and_conf/nofilter-swir: (1, 18), ./bad_pixels_tools_and_conf/nofilter-vnir: (1, 18). Threshold=./bad_pixels_tools_and_conf/nofilter-swir: 3.0, ./bad_pixels_tools_and_conf/nofilter-vnir: 3.0
2023-12-08 15:00:36,440 INFO methodE = ManualDetection. Manual detection of bad pixels from level 1 test set.
2023-12-08 15:00:36,440 INFO methodF = LowResponse. If the average spectral response of the band is less than a threshold %% of the average maximum response for the sensor. Threshold=./bad_pixels_tools_and_conf/nofilter-swir: 0.3, ./bad_pixels_tools_and_conf/nofilter-vnir: 0.1
2023-12-08 15:00:36,440 INFO methodG = Identified from BPR file acquired at data collection.
2023-12-08 15:00:36,440 INFO Number of bad pixels decoded from file: 0
2023-12-08 15:00:36,440 INFO Number of frames of image (minus dark frames) should be: 1818
2023-12-08 15:00:36,440 INFO Number of dark frames is: 99
2023-12-08 15:00:36,440 INFO Number of missing frames is: 0
2023-12-08 15:00:36,440 INFO Number of frames in final calibrated image will be: 1818
2023-12-08 15:00:36,440 INFO Number of samples in final calibrated image will be: 640
2023-12-08 15:00:36,440 INFO The job will complete the following tasks:
2023-12-08 15:00:36,440 INFO Remove dark frames: 1
2023-12-08 15:00:36,440 INFO Calibrate FODIS (if exists): 0
2023-12-08 15:00:36,440 INFO Insert missing scans as line of 0's: 1
2023-12-08 15:00:36,440 INFO Apply radiometric gains: 1
2023-12-08 15:00:36,440 INFO Smear correct the data (if Eagle): 0
2023-12-08 15:00:36,440 INFO Output the mask file: 1
2023-12-08 15:00:36,440 INFO Output the mask method file: 1
2023-12-08 15:00:36,440 INFO Flip the raw data spectrally (red to blue): 0
2023-12-08 15:00:36,441 INFO Flip the raw data spatially (left to right): 0
2023-12-08 15:00:36,441 INFO Apply QC failure bad pixels: 0
2023-12-08 15:00:36,462 INFO Will bin calibration file so that it has 112 bands and 640 samples.
2023-12-08 15:00:36,462 INFO ---------- WARNING ----------
2023-12-08 15:00:36,462 INFO INFO: Using the averaging method for binning - this is used for most of the 'modern' sensors.
2023-12-08 15:00:36,462 INFO ---------- ------- ----------
2023-12-08 15:00:36,469 INFO Will trim calibration file so that it has 112 bands and 640 samples.
2023-12-08 15:00:36,470 INFO Will write calibrated image data to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil
2023-12-08 15:00:36,470 INFO Will write calibrated image mask data to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil
2023-12-08 15:00:36,470 INFO Will write bad pixel method data to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask-badpixelmethod.bil
2023-12-08 15:00:36,956 INFO Approximate percent complete: 10 at line 180
2023-12-08 15:00:37,461 INFO Approximate percent complete: 20 at line 361
2023-12-08 15:00:38,026 INFO Approximate percent complete: 30 at line 542
2023-12-08 15:00:38,608 INFO Approximate percent complete: 40 at line 723
2023-12-08 15:00:39,281 INFO Approximate percent complete: 50 at line 904
2023-12-08 15:00:39,872 INFO Approximate percent complete: 60 at line 1085
2023-12-08 15:00:40,445 INFO Approximate percent complete: 70 at line 1266
2023-12-08 15:00:41,066 INFO Approximate percent complete: 80 at line 1447
2023-12-08 15:00:41,590 INFO Approximate percent complete: 90 at line 1628
2023-12-08 15:00:42,065 INFO Approximate percent complete: 100 at line 1809
2023-12-08 15:00:42,083 INFO Calibration processing completed.
2023-12-08 15:00:42,084 INFO Processing completed successfully
2023-12-08 15:00:42,084 INFO Calibration successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil'
2023-12-08 15:00:42,084 INFO Step 8 of 16 - MASKING: Running masking operation
2023-12-08 15:00:42,093 INFO Will use input Level-1 BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil
2023-12-08 15:00:42,093 INFO Will write masked data to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil
2023-12-08 15:00:42,093 INFO Will use input mask BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil
2023-12-08 15:00:42,093 INFO Will flag all pixels which are not good (have non-zero value in mask file).
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 0 equivalent to value: 1
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 1 equivalent to value: 2
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 2 equivalent to value: 4
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 3 equivalent to value: 8
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 4 equivalent to value: 16
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 5 equivalent to value: 32
2023-12-08 15:00:42,094 INFO Will test against mask bit position: 6 equivalent to value: 64
2023-12-08 15:00:42,257 INFO Approximate percent complete: 10 at line 180
2023-12-08 15:00:42,349 INFO Approximate percent complete: 20 at line 361
2023-12-08 15:00:42,441 INFO Approximate percent complete: 30 at line 542
2023-12-08 15:00:42,536 INFO Approximate percent complete: 40 at line 723
2023-12-08 15:00:42,671 INFO Approximate percent complete: 50 at line 904
2023-12-08 15:00:42,777 INFO Approximate percent complete: 60 at line 1085
2023-12-08 15:00:42,883 INFO Approximate percent complete: 70 at line 1266
2023-12-08 15:00:42,975 INFO Approximate percent complete: 80 at line 1447
2023-12-08 15:00:43,075 INFO Approximate percent complete: 90 at line 1628
2023-12-08 15:00:43,174 INFO Approximate percent complete: 100 at line 1809
2023-12-08 15:00:43,178 INFO Processing completed successfully
2023-12-08 15:00:43,179 INFO Masking successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil'
2023-12-08 15:00:43,179 INFO Step 9 of 16 - NAVIGATION: Running navigation operation
2023-12-08 15:00:43,187 INFO Operating system: Linux Release: 5.15.0-86-generic Version: #96~20.04.1-Ubuntu SMP Thu Sep 21 13:23:37 UTC 2023
2023-12-08 15:00:43,187 INFO Machine information: x86_64 Host name: 2ced290e82a3 Domain name: (none)
2023-12-08 15:00:43,187 INFO Will use Specim Navigation file: /opt/geona/data/workspace/7fb9b358/capture/day2_f3_20200924_080555.nav
2023-12-08 15:00:43,187 INFO Will write to output BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil
2023-12-08 15:00:43,187 INFO Will read the sensor data properties from the level-1 file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil
2023-12-08 15:00:43,187 INFO Will apply lever arm corrections of (X,Y,Z): 0 0 0
2023-12-08 15:00:43,187 INFO Will apply boresight corrections of (R,P,H): 0 0 0
2023-12-08 15:00:43,188 INFO No SBET/SOL file has been given, therefore will read real-time navigation data from Specim .nav file: /opt/geona/data/workspace/7fb9b358/capture/day2_f3_20200924_080555.nav
2023-12-08 15:00:43,188 INFO No user-supplied scan time offset to be applied.
2023-12-08 15:00:43,188 INFO No smoothing of navigation data to be applied.
2023-12-08 15:00:43,188 INFO Will use the interpolation method: Linear
2023-12-08 15:00:43,188 INFO Will not use a position-attitude offset.
2023-12-08 15:00:43,188 INFO Will use the given nav system: AppPos
2023-12-08 15:00:43,205 INFO ---------- WARNING ----------
2023-12-08 15:00:43,205 INFO There are no SPTSMP2 sync messages in this .nav file - will try to use SPTSMP instead.
2023-12-08 15:00:43,205 INFO ---------- ------- ----------
2023-12-08 15:00:43,219 INFO Height difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,219 INFO Latitude difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,219 INFO Longitude difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,219 INFO Roll difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,219 INFO Pitch difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,219 INFO Heading difference between consecutive epochs larger than acceptable threshold. Further warnings of this type suppressed.
2023-12-08 15:00:43,219 INFO Start and end times of file: Type 17NMEASpecimNavData 371221 371253
2023-12-08 15:00:43,219 INFO Number of scans: 1818
2023-12-08 15:00:43,219 INFO Sync from header:-999
2023-12-08 15:00:43,219 INFO Date: 2020-09-24
2023-12-08 15:00:43,219 INFO Frame rate from header:69.99
2023-12-08 15:00:43,219 INFO Using cropped level-1 data - will add a time offset relating to number of lines cropped (y start + dropped scans values in hdr): 0
2023-12-08 15:00:43,219 INFO Leap second data value 2006-01-01 14
2023-12-08 15:00:43,219 INFO Leap second data value 2009-01-01 15
2023-12-08 15:00:43,220 INFO Leap second data value 2012-07-01 16
2023-12-08 15:00:43,220 INFO Leap second data value 2015-07-01 17
2023-12-08 15:00:43,220 INFO Leap second data value 2017-01-01 18
2023-12-08 15:00:43,220 INFO Using leap seconds of:18
2023-12-08 15:00:43,220 INFO Finding per-scan times...
2023-12-08 15:00:43,220 INFO Running new-style scan syncer function without level-1 header start time.
2023-12-08 15:00:43,220 INFO sync time: 0.9876 sync_gps: 371224 frame: 0
2023-12-08 15:00:43,220 INFO sync time: 0.9875 sync_gps: 371225 frame: 70
2023-12-08 15:00:43,220 INFO sync time: 0.9873 sync_gps: 371226 frame: 140
2023-12-08 15:00:43,220 INFO sync time: 0.9871 sync_gps: 371227 frame: 210
2023-12-08 15:00:43,220 INFO sync time: 0.987 sync_gps: 371228 frame: 280
2023-12-08 15:00:43,220 INFO sync time: 0.9868 sync_gps: 371229 frame: 350
2023-12-08 15:00:43,220 INFO sync time: 0.9867 sync_gps: 371230 frame: 420
2023-12-08 15:00:43,220 INFO sync time: 0.9865 sync_gps: 371231 frame: 490
2023-12-08 15:00:43,220 INFO sync time: 0.9864 sync_gps: 371232 frame: 560
2023-12-08 15:00:43,220 INFO sync time: 0.9862 sync_gps: 371233 frame: 630
2023-12-08 15:00:43,220 INFO sync time: 0.986 sync_gps: 371234 frame: 700
2023-12-08 15:00:43,220 INFO sync time: 0.9859 sync_gps: 371235 frame: 770
2023-12-08 15:00:43,220 INFO sync time: 0.9857 sync_gps: 371236 frame: 840
2023-12-08 15:00:43,220 INFO sync time: 0.9999 sync_gps: 371237 frame: 909
2023-12-08 15:00:43,220 INFO sync time: 0.9997 sync_gps: 371238 frame: 979
2023-12-08 15:00:43,221 INFO sync time: 0.9995 sync_gps: 371239 frame: 1049
2023-12-08 15:00:43,221 INFO sync time: 0.9994 sync_gps: 371240 frame: 1119
2023-12-08 15:00:43,221 INFO sync time: 0.9992 sync_gps: 371241 frame: 1189
2023-12-08 15:00:43,221 INFO sync time: 0.9991 sync_gps: 371242 frame: 1259
2023-12-08 15:00:43,221 INFO sync time: 0.9989 sync_gps: 371243 frame: 1329
2023-12-08 15:00:43,221 INFO sync time: 0.9988 sync_gps: 371244 frame: 1399
2023-12-08 15:00:43,221 INFO sync time: 0.9986 sync_gps: 371245 frame: 1469
2023-12-08 15:00:43,221 INFO sync time: 0.9984 sync_gps: 371246 frame: 1539
2023-12-08 15:00:43,221 INFO sync time: 0.9983 sync_gps: 371247 frame: 1609
2023-12-08 15:00:43,221 INFO sync time: 0.9981 sync_gps: 371248 frame: 1679
2023-12-08 15:00:43,221 INFO sync time: 0.998 sync_gps: 371249 frame: 1749
2023-12-08 15:00:43,221 INFO Using the per second sync messages in this specim nav file.
2023-12-08 15:00:43,221 INFO First sync delay value: 0.9876
2023-12-08 15:00:43,221 INFO Time for first scanline (no adjustments made): 371224
2023-12-08 15:00:43,221 INFO Time for first scanline (adjusted for sync message): 371223.0124
2023-12-08 15:00:43,221 INFO Applying crop time offset of: 0
2023-12-08 15:00:43,221 INFO Time for first scanline (adjusted for croptime): 371223.0124
2023-12-08 15:00:43,221 INFO Time for first scanline (adjusted for frame grabber delay): 371223.0124
2023-12-08 15:00:43,221 INFO First scan will have time: 371223.0124.  Last scan will have time: 371248.9736
2023-12-08 15:00:43,221 INFO Not applying leapsecond offset to SPECIM nav data.
2023-12-08 15:00:43,221 INFO Creating Navigation Interpolation object...
2023-12-08 15:00:43,221 INFO Detected this file as Specim nav as it failed sbet and sol tests: /opt/geona/data/workspace/7fb9b358/capture/day2_f3_20200924_080555.nav
2023-12-08 15:00:43,240 INFO ---------- WARNING ----------
2023-12-08 15:00:43,240 INFO There are no SPTSMP2 sync messages in this .nav file - will try to use SPTSMP instead.
2023-12-08 15:00:43,240 INFO ---------- ------- ----------
2023-12-08 15:00:43,267 INFO ---------- WARNING ----------
2023-12-08 15:00:43,267 INFO There are no SPTSMP2 sync messages in this .nav file - will try to use SPTSMP instead.
2023-12-08 15:00:43,267 INFO ---------- ------- ----------
2023-12-08 15:00:43,281 INFO Height difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,281 INFO Latitude difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,281 INFO Longitude difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,281 INFO Roll difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,281 INFO Pitch difference between consecutive epochs larger than acceptable threshold. Further warnings of this type supressed.
2023-12-08 15:00:43,281 INFO Heading difference between consecutive epochs larger than acceptable threshold. Further warnings of this type suppressed.
2023-12-08 15:00:43,281 INFO Start and end times of file: Type 17NMEASpecimNavData 371221 371253
2023-12-08 15:00:43,282 INFO Setting times to interpolation object...
2023-12-08 15:00:43,282 INFO Interpolating navigation data to scan times...
2023-12-08 15:00:43,283 INFO Adding leverarm correction...
2023-12-08 15:00:43,284 INFO Adding boresight correction...
2023-12-08 15:00:43,284 INFO Checking plausibilty of the interpolated data...
2023-12-08 15:00:43,284 INFO Writing data out...
2023-12-08 15:00:43,285 INFO Navigation processing completed.
2023-12-08 15:00:43,285 INFO Processing completed successfully
2023-12-08 15:00:43,286 INFO Navigation processing successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil'
2023-12-08 15:00:43,286 INFO Step 10 of 16 - GEOCORRECTION: Running geocorrection operation
2023-12-08 15:00:43,294 INFO Will use view vector file: /opt/geona/data/workspace/7fb9b358/auxilliary/FOV_AFX17_sn2100014_20200429_1b_converted.bil
2023-12-08 15:00:43,295 INFO Will use navigation data from file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil
2023-12-08 15:00:43,295 INFO Will apply default boresight corrections of (X,Y,Z): 0 0 0
2023-12-08 15:00:43,295 INFO Will write per-pixel positions (longitude,latitude,height) to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_latlon.igm
2023-12-08 15:00:43,295 INFO Using default Ellipsoid of WGS-84.
2023-12-08 15:00:43,295 INFO Will not add a height correction to the ellipsoid surface.
2023-12-08 15:00:43,295 INFO Will use default view vector method: split
2023-12-08 15:00:43,295 INFO Warning: No Digital Elevation Model given. Will map to Ellipsoid surface (+offset if given).
2023-12-08 15:00:43,295 INFO Will trim view vectors to fit the level 1 filename: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil
2023-12-08 15:00:43,295 INFO Creating view vector object.
2023-12-08 15:00:43,319 INFO Aircraft start position (Lon,Lat,Hei): 24.92437015 60.25899316 126.26
2023-12-08 15:00:43,319 INFO Aircraft navigation start time: 25641.0124
2023-12-08 15:00:43,319 INFO Aircraft end position (Lon,Lat,Hei): 24.92392881 60.26057459 126.83
2023-12-08 15:00:43,319 INFO Aircraft navigation end time: 25666.97361
2023-12-08 15:00:43,319 INFO Total number of navigation scan lines to map: 1818
2023-12-08 15:00:43,334 INFO Navigation Min/Max Latitude: 60.25899316 60.26057459
2023-12-08 15:00:43,334 INFO Navigation Min/Max Longitude: 24.92392881 24.92437015
2023-12-08 15:00:43,334 INFO Navigation Min/Max Height: 126.25 126.83
2023-12-08 15:00:43,334 INFO Navigation Min/Max Roll: -2.375583666 0.724204072
2023-12-08 15:00:43,334 INFO Warning - no Digital Elevation Model was given on command line. Will map to ellipsoid surface.
2023-12-08 15:00:43,334 INFO Creating an output file for a line scanner IGM.
2023-12-08 15:00:43,334 INFO Processing section with scan bounds: 0 : 1818
2023-12-08 15:00:43,399 INFO Approximate percent complete: 10 at line 180
2023-12-08 15:00:43,461 INFO Approximate percent complete: 20 at line 361
2023-12-08 15:00:43,525 INFO Approximate percent complete: 30 at line 542
2023-12-08 15:00:43,590 INFO Approximate percent complete: 40 at line 723
2023-12-08 15:00:43,657 INFO Approximate percent complete: 50 at line 904
2023-12-08 15:00:43,721 INFO Approximate percent complete: 60 at line 1085
2023-12-08 15:00:43,786 INFO Approximate percent complete: 70 at line 1266
2023-12-08 15:00:43,849 INFO Approximate percent complete: 80 at line 1447
2023-12-08 15:00:43,916 INFO Approximate percent complete: 90 at line 1628
2023-12-08 15:00:43,983 INFO Approximate percent complete: 100 at line 1809
2023-12-08 15:00:43,987 INFO Geocorrection processing completed.
2023-12-08 15:00:43,987 INFO Processing completed successfully
2023-12-08 15:00:43,987 INFO Georeferencing processing successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_latlon.igm'
2023-12-08 15:00:43,988 INFO Step 11 of 16 - TRANSFORMATION: Running transformation operation
2023-12-08 15:00:43,989 INFO Output reprojection will UTM WGS84 35 N (detected from navigation data)
2023-12-08 15:00:43,999 INFO Will use input IGM BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_latlon.igm
2023-12-08 15:00:43,999 INFO Will use output IGM BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_reprojected.igm
2023-12-08 15:00:43,999 INFO Will reproject data into UTM coordinate system: using Zone 35 North. Using code: EPSG:32635
2023-12-08 15:00:43,999 INFO PROJ format input projection string: EPSG:4326
2023-12-08 15:00:44,008 INFO PROJ format output projection string: EPSG:32635
2023-12-08 15:00:44,009 INFO Will use a 'no data value' of: -9999
2023-12-08 15:00:44,009 INFO Please note that Z values are not transformed and will remain in the input reference.
2023-12-08 15:00:44,076 INFO Approximate percent complete: 10 at line 180
2023-12-08 15:00:44,140 INFO Approximate percent complete: 20 at line 361
2023-12-08 15:00:44,202 INFO Approximate percent complete: 30 at line 542
2023-12-08 15:00:44,267 INFO Approximate percent complete: 40 at line 723
2023-12-08 15:00:44,330 INFO Approximate percent complete: 50 at line 904
2023-12-08 15:00:44,392 INFO Approximate percent complete: 60 at line 1085
2023-12-08 15:00:44,455 INFO Approximate percent complete: 70 at line 1266
2023-12-08 15:00:44,523 INFO Approximate percent complete: 80 at line 1447
2023-12-08 15:00:44,589 INFO Approximate percent complete: 90 at line 1628
2023-12-08 15:00:44,654 INFO Approximate percent complete: 100 at line 1809
2023-12-08 15:00:44,687 INFO Average nadir pixel sizes in along track, across track are: 0.1235367189 0.1318274931
2023-12-08 15:00:44,688 INFO Average nadir pixel sizes in projected X,Y are: 0.1406405885 0.1107110769
2023-12-08 15:00:44,688 INFO Coordinate Transformation Complete
2023-12-08 15:00:44,688 INFO Processing completed successfully
2023-12-08 15:00:44,691 INFO Coordinate transform processing successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_reprojected.igm'
2023-12-08 15:00:44,691 INFO Step 12 of 16 - MAPPING: Running mapping operation
2023-12-08 15:00:44,705 INFO Will use input IGM BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_reprojected.igm
2023-12-08 15:00:44,705 INFO Will use input Level-1 BIL file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil
2023-12-08 15:00:44,706 INFO Will use pixelsize: 1 1
2023-12-08 15:00:44,706 INFO Will map bands: ALL which sums to 1 group(s) of bands.
2023-12-08 15:00:44,706 INFO Will write map to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_mapped.bil
2023-12-08 15:00:44,706 INFO Will map using the interpolation algorithm defined by: nearest
2023-12-08 15:00:44,706 INFO Will assign a buffer size for input data of (MB): 1024
2023-12-08 15:00:44,706 INFO Will write out data as type: uint16. Note if writing as netcdf this will be ignored.
2023-12-08 15:00:44,706 INFO Will output Level-1 row/col mapping to file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_rowcol.bil
2023-12-08 15:00:44,706 INFO Will output latitude and longitude grids to: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_x.bil /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_y.bil
2023-12-08 15:00:44,706 INFO Will write data into a bil file.
2023-12-08 15:00:44,706 INFO Assuming a projected data set - not in latitude/longitude. Uses projection keyword in igm hdr and tests vs 'Geographic Lat/Lon'.
2023-12-08 15:00:44,725 INFO Average nadir pixel size East: 0.1406405885 North: 0.1107110769
2023-12-08 15:00:44,805 INFO Area defined by IGM file fits within rectangle: 385084.962 < X < 385192.0962 6682055.136 < Y < 6682239.661
2023-12-08 15:00:44,806 INFO Getting data type from file: /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil is 12 and converted to output FileWriter type is 2
2023-12-08 15:00:44,809 INFO Initialisation is now complete. Starting mapping ...
2023-12-08 15:00:44,810 INFO Number of rows, columns and bands of output mapped image file: 185 109 112
2023-12-08 15:00:44,810 INFO Final mapped image (if a BIL/BSQ file) /opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_mapped.bil will require 5 megabytes of disk space.
2023-12-08 15:00:44,810 INFO Total amount of disk space: 937795
2023-12-08 15:00:44,810 INFO Amount of free disk space available: 748037
2023-12-08 15:00:44,810 INFO Will use a default value for maximum interpolation of three times the average separation of a nadir pixel. This is: 0.5369641133 metres.
2023-12-08 15:00:44,810 INFO Interpolating level1 data ignoring values of: 0 This may be different to entered value as it has been cast to level-1 data type.
2023-12-08 15:00:44,838 INFO Either outline cannot be created from an IGM file not in ARSF style or use_outline set to false - faking outline to be the full size of the grid.
2023-12-08 15:00:45,349 INFO Approximate percent complete: 10
2023-12-08 15:00:45,362 INFO Approximate percent complete: 20
2023-12-08 15:00:45,383 INFO Approximate percent complete: 30
2023-12-08 15:00:45,397 INFO Approximate percent complete: 40
2023-12-08 15:00:45,411 INFO Approximate percent complete: 50
2023-12-08 15:00:45,428 INFO Approximate percent complete: 60
2023-12-08 15:00:45,445 INFO Approximate percent complete: 70
2023-12-08 15:00:45,463 INFO Approximate percent complete: 80
2023-12-08 15:00:45,479 INFO Approximate percent complete: 90
2023-12-08 15:00:45,497 INFO Approximate percent complete: 100
2023-12-08 15:00:45,527 INFO Processing completed successfully
2023-12-08 15:00:45,533 INFO Mapping successfully ran to produce '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_mapped.bil'
2023-12-08 15:00:45,533 INFO Step 13 of 16 - QUICKLOOK: Generating quicklook preview of mapped data
2023-12-08 15:00:45,582 INFO Input file size is 109, 185
2023-12-08 15:00:45,591 INFO 0...10...20...30...40...50...60...70...80...90...100 - done.
2023-12-08 15:00:45,594 INFO Step 14 of 16 - TRANSFER_RESULTS: Uploading results to output location
2023-12-08 15:00:45,732 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil'
2023-12-08 15:00:45,874 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask-badpixelmethod.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil_mask-badpixelmethod.bil'
2023-12-08 15:00:45,874 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask-badpixelmethod.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil_mask-badpixelmethod.bil.hdr'
2023-12-08 15:00:45,877 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_mapped.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_mapped.bil'
2023-12-08 15:00:45,877 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_y.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_grid_y.bil.hdr'
2023-12-08 15:00:46,135 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil'
2023-12-08 15:00:46,136 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_x.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_grid_x.bil'
2023-12-08 15:00:46,136 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_mapped.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_mapped.bil.hdr'
2023-12-08 15:00:46,136 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil.hdr'
2023-12-08 15:00:46,136 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_nav_post_processed.bil'
2023-12-08 15:00:46,136 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_rowcol.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_rowcol.bil'
2023-12-08 15:00:46,324 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_masked.bil'
2023-12-08 15:00:46,325 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_y.bil' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_grid_y.bil'
2023-12-08 15:00:46,325 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_ql.png' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_ql.png'
2023-12-08 15:00:46,344 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_latlon.igm' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_latlon.igm'
2023-12-08 15:00:46,344 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_grid_x.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_grid_x.bil.hdr'
2023-12-08 15:00:46,344 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_reprojected.igm.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_reprojected.igm.hdr'
2023-12-08 15:00:46,345 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_ql.png.aux.xml' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_ql.png.aux.xml'
2023-12-08 15:00:46,364 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_reprojected.igm' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_reprojected.igm'
2023-12-08 15:00:46,364 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_rowcol.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_rowcol.bil.hdr'
2023-12-08 15:00:46,364 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_masked.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_masked.bil.hdr'
2023-12-08 15:00:46,364 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil.hdr'
2023-12-08 15:00:46,364 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_latlon.igm.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_latlon.igm.hdr'
2023-12-08 15:00:46,365 INFO Output file '/opt/geona/data/workspace/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil.hdr' copied to '/opt/geona/data/outputs/7fb9b358/day2_f3_20200924_080555_level1.bil_mask.bil.hdr'
2023-12-08 15:00:46,365 INFO Output file '/opt/geona/data/workspace/7fb9b358/config_7fb9b358.ini' copied to '/opt/geona/data/outputs/7fb9b358/config_7fb9b358.ini'
2023-12-08 15:00:46,365 INFO Step 15 of 16 - CLEANUP: Cleaning up workspace
2023-12-08 15:00:46,366 INFO Step 16 of 16 - COMPLETE: Processing complete
2023-12-08 15:00:46,366 INFO Processing complete for Job ID: 7fb9b358
2023-12-08 15:00:46,377 INFO Output file '/opt/geona/data/workspace/7fb9b358/status_7fb9b358.json' copied to '/opt/geona/data/outputs/7fb9b358/status_7fb9b358.json'
2023-12-08 15:00:46,377 INFO Output file '/opt/geona/data/workspace/7fb9b358/job_id_7fb9b358.log' copied to '/opt/geona/data/outputs/7fb9b358/job_id_7fb9b358.log'
2023-12-08 15:00:46,418 INFO Processing complete