McIDAS Man computer Interactive Data Access System

Updated the McIDAS-V User’s Guide to contain new features and more detailed content.

Added new display types for Vector Colored by Speed, Vector Colored by Another Parameter, Wind Barb Colored by Speed, and Wind Barb Colored by Another Parameter. Additionally, if four or more timesteps are displayed, new features in the Layer Controls allow for changing the display to trajectories or curly vectors. If trajectories are chosen, then there are four options for how the trajectories are drawn. These options are Line, Cylinder, Ribbon, and Deform Ribbon. Curly vectors are the same as regular vectors, with the exception that they are multiple timesteps in length.

Added new display types for 3D Volume Vector, 3D Volume Vector Colored by Speed, 3D Volume Vector Colored by Another Parameter, and 3D Volume Trajectory. For these display types, there is the option to switch between displaying vectors and trajectories. When trajectories is chosen, there are different options for setting how the trajectories are drawn in the display. These options are Line, Cylinder, Ribbon, and Deform Ribbon. By default, the trajectories will be drawn at every vertical level included with the data at the specified Z Skip which is defined in the Layer Controls. The Trajectory Start Level dropdown menu can be used to set trajectories to originate at a single vertical level instead of all levels at once. Four or more timesteps must be displayed in order to plot trajectories.

Added new transect tab and window types that can be accessed in the Main Display window. The new types include:

• File>New Display Tab/Window>Transect Display>Three Panels
• File>New Display Tab/Window>Transect Display>Four Panels
• File>New Display Tab/Window>Misc>1 Map 2 Transects
• File>New Display Tab/Window>Misc>2 Maps 1 Transect

Added a new setting that displays overlapping layers of differing resolutions in a way that there is no display interference when the display is rotated. This setting is enabled by default in the Display Window tab of the User Preferences. This setting can also be ontrolled on a display by display basis through the View>Properties menu in a panel.

Added a new local server to work with Himawari HSD (Himawari Standard Data) formatted files (*.DAT). To create a local dataset using this server, from the ADDE Data Manager, click the Add New Dataset button and select the ‘Himawari 8’ Format. The file names must match the JMA HSD image file naming convention, HS_aaa_yyyymmdd_hhnn_Bbb_cccc_Rjj_Skkll.DAT, described in the Himawari Standard Data User’s Guide. This server is currently supported on Linux and OS X.

Added new local servers to work with INSAT-3D Imager and Sounder files (*.h5). To create a local dataset using this server, from the ADDE Data Manager, click the Add New Dataset button and select the ‘INSAT-3D Imager’ or ‘INSAT-3D Sounder’ Format. These servers are currently supported on Linux and OS X.

Added new local servers to work with Level 1b GOES-R ABI files in the netCDF-4 format. The names of these files should look similar to this: OR_ABI-L1b-RadC-M4C16_G16_s20151702215532_e20151702220362_c20151702220394.nc. To create a local dataset using this server, from the ADDE Data Manager, click the Add New Dataset button and select the ‘GOES-16 ABI’ Format. These servers are currently supported on Linux and OS X.

Added a new button to the top of the Fields panel of the Field Selector to toggle between the longname and shortname descriptions of each field in the data source. This is only an option if the fields populating the Fields panel are from a NetCDF-formatted data source.

Added the ability to work with Julian dates with archive imagery servers. Once an Image Type is selected in a chooser, in the Set Archive Day window, Julian dates can be entered. For example:

• 001 – Day 1 of the current year
• 13255 – Day 255 of year 2013
• 2015150 – Day 150 of year 2015

In the past, users were limited to entering dates such as ‘Jun 19, 2015’.

Added a List All Images button to the Absolute times tab of the Satellite>Imagery chooser. By default, only up the 100 most recent images in the dataset will be listed to save time. Clicking this button requests the server to list all of the relevant times in the times panel. Dependent on the server and number of images in the dataset, this may take some time to complete.

Added a ‘Use ‘global’ GIF color palette‘ option when saving a movie. This option is applicable for animated GIF movies, and it is enabled by default. Animated GIFs are limited to 256 colors, and this option uses the same 256 colors for every frame in the loop when the setting is enabled. Enabling this option allows for certain display settings such as a color scale to remain constant throughout the loop. If this option is disabled, then each frame uses it’s own color palette, so one color may represent one value in one frame, and the same color may represent a different value in the next frame. One circumstance where disabling this option may be ideal is if the movie starts with a low-light scene (not many colors) and there is no color scale in the display.

Added a variety of functionality related to scripting since the release of 1.5. Below is a list of significant changes:

• New functions:
  • Added a new function called setMapVisibilityByDescription() that allows for showing or hiding individual maps from the display.
  • Added a new function called findWindow() that returns a reference to the display window containing a buildWindow() panel. This allows for performing operations on a window such as adding new tabs or closing the window.
  • Added new functions to modify displays of point data, which are outlined in the ‘Modify the Layer Object – Point’ page.
  • Added a new function called getData() which returns a data object from a displayed layer. This data object can then be passed through formulas.
  • Added new lister functions for Suomi NPP VIIRS data (described below in the Under Development section).
  • Added a new function called describe() which returns a variety of statistical parameters about an imagery or gridded data object. These statistical parameters include a histogram, length, min, max, range, Q1, Q2, Q3, IQR, mean, mode, kurtosis, skewness, standard deviation, and variance.
  • Added a new function called sparkline() which returns a histogram of data values from an imagery or gridded data object.
  • Added a new function called importEnhancement() which allows for importing local enhancement files for use in scripts and the user interface.
  • Added a new function called sandwich() which is defined in the Sandwich Product library in the Jython Libraries. This function creates a sandwich RGB display using infrared and visible data, as well as user-defined minimum and maximum infrared values, a color enhancement, and the ability to specify if missing values should be plotted in the display.
• New functionality with existing functions:
  • Added new information to the metadata of the data object returned from loadGrid. This new metadata is in the form of three new keys: globalAttributes, metadataVariables, and variableAttributes. Information on accessing these keys and their values can be found on the ‘Create an Object – Grids’ page.
  • Added a new keyword to the captureImage() and writeMovie() functions called createDirectories. This createDirectories key, if set to True, allows for the creation of the directory path specified in the command if it does not already exist.
  • Added new fontSize and fontFace keywords to the Colorbar formatting option of captureImage.
  • Added a new keyword to buildWindow called widgets. This keyword, if set to false, builds a display window without any toolbar buttons and only the display panel.
• Miscellaneous scripting-related changes:
  • For remote datasets requiring accounting that are already defined in the ADDE Data Manager, there is no need to specify the accounting keyword in the imagery-related functions. This includes loadADDEImage, listADDEImages, and listADDEImageTimes. A benefit of this change is that users can share scripts without including any accounting information.
  • Added syntax highlighting to the Jython libraries window. Also added keyboard shortcuts to assist with searching for text in the currently open library.
  • Added syntax highlighting to the Jython Shell window when multi-line input is being used.
  • Print statements are no longer required in the Jython Shell when a single line of code is being evaluated. Below are a couple of examples:
    • Command: 2+6
    • Output: 8
    • Command: layer.getEnhancementTable()
    • Output: Inverse Gray shade

Updated Java version from 1.7.0_60 to 1.8.0_45.

Updated the installation GUI. The first update is that the GUI now prompts the user if McIDAS-V should be installed into the same directory that McIDAS-V was last installed into (overwriting any previous version), or if it should be installed into a different directory. If the option of installing into the existing installation directory is selected, then the installation GUI will skip the step where the installation directory is selected. If the user selects to install into a different directory, there is a new feature that allows for the creation of a new directory within the installer. There were also updates to allow for installing into and running from directory paths that include spaces.

Added support for AWIPS II *.cmap colormaps (enhancements). These files can be imported through the Color Table Editor.

Added support for subsetting EDR and SDR granule aggregations containing missing scanlines. Added initial support for NASA VIIRS L1b formatted files. Also added a couple new functions to list information about VIIRS files:

• listVIIRSFieldsInFile(filename) – Returns a list of the fields included with the file passed through the function. These field names can then be passed through the loadVIIRSImage() function to create a data object that can then be displayed.
• listVIIRSTimesInField(filename, field) – Returns the beginning date and time of the file passed through the function.

Added the ability to customize the vertical scale labeling around the wireframe box in the Main Display window. This feature is available in the Vertical Scale tab of the Properties window for the display panel, as well as from the ‘Set the vertical range’ button in the Main Display. The new features include adding the ability to set the axis label, the increment of the labels, minor division tick marks, as well as setting the font. Note that this vertical scale will be visible only if the Show Display Scales option is turned on in the display panel.

Added the ability to set an interval for how many contour lines are labeled. In the Contour Properties Editor window, there is a new Label Every Nth Line item that allows you to set a contour line labeling interval. By default this is set to a value of 2, which means that every other contour line will be labeled. Decrease this value to increase the number of contours with labels, and increase this number to decrease the number of contours with labels.

Added the ability for users to subset entire granules of MODIS and Suomi NPP data. In previous McIDAS-V versions, there were limitations to how close a subset box could be made to the edge of the data. This subsetting occurs in the Region tab of the Field Selector using Shift+click+drag over the data before creating the display.

Improved probe output for Level III Hydrometeor Classification products and the Suomi NPP Quality Flag fields. For Level III Radar data once a Hydrometeor Classification product is added, an Image Display of the ‘Hydro class’ field now creates a display with actual text output. Examples of this text output are ‘Dry Snow’, ‘Light-Moderate Rain’ and ‘Biological’. For Suomi NPP Quality Flags listed in the Field Selector, an Image Display will also provide text output. An example of this output for a ‘Fire’ QF field would be ‘True’ or ‘False’. An example of this output for a ‘Cloud Phase’ QF field would be ‘Clear’, ‘Water’, or ‘Ice’.

Added support for GEMPAK Upper Air files (*.gem) through the Point Observations -> Soundings -> Local chooser.

Added local servers for AMSR-E L2a and the AMSR-E Rain Product. These server formats are available in the Local ADDE Data Manager and can also be accessed through scripting.

Added a new feature called Time Matching that is designed to create loops that accommodate data with differing temporal frequencies. An example where time matching would be useful is if a user wants to create a loop of satellite data overlaid with radar data but they have different frequencies (e.g., the satellite data comes in twice an hour while the radar data comes in eight times an hour). In the past, a user would have to use the Absolute Times tab of the radar data and individually select the times closest to those of the satellite data. With time matching, this is no longer necessary. Now, a user can set one layer to be the time driver, and other layers can then be selected to match the time driver times.

Added a new Match Display Region option to the dropdown menu in the Region tab of the Field Selector. When this option is used, the data being displayed will automatically be spatially subsetted to match the geographical domain of the active panel in the Main Display. This helps create efficient displays of data by not displaying more data than necessary. This Match Display Region mode can be used with the Gridded Data and Point Observations choosers.

An example use case of this feature is if a user is working with global gridded data, but is only interested in displaying data over the United States. First, the user would change their display to over the United States, and then choose the Match Display Region mode in the Region tab of the Field Selector when creating the display. In doing this, only data over the United States would be displayed.

Changed the name of getADDEImage to loadADDEImage. The name change was made for consistency with other functions in both naming as well as what is returned from the function. In the past, getADDEImage returned two objects: metadata, and one object containing both data and metadata. Now, loadADDEImage only returns the one object containing both the data and metadata. Users can call the single object returned from loadADDEImage in the same way the metadata object from getADDEImage was returned in the past. Scripts using getADDEImage will continue to work, though we recommend transitioning to loadADDEImage as this is the documented function, and any new functionalities will be added to loadADDEImage, not getADDEImage.

Added new functions for working with gridded data, including netCDF, hdf, and grib formats. This function is called loadGrid. There are also a variety of new lister functions to give users information about the file loaded in via loadGrid, including loadGridFieldsInFile, loadGridLevelsInField, and loadGridTimesInField.

Added additional features to captureImage. This includes a new bgtransparent keyword to set the background of the image transparent, as well as a variety of new formatting options for the output image. These formatting options include adding a matte, colorbar, image overlay and text overlay to the output image. New output formats are also now supported, including *.pdf, *.ps, *.svg, *.kml, and *.kmz.

Added a new transparency keyword to setEnhancement. This allows for setting a transparency value across an entire enhancement.

Updated Java version from 1.6.0_31 to 1.7.0_60. Updated Java 3D version from 1.5.2 to 1.6.0.

Added a variety of sample bundles to the Main Toolbar of McIDAS-V, under a button labeled Current WX. These sample bundles are referred to as system bundles. Clicking on Current WX opens a dropdown with a variety of bundles that display real-time weather from data sources including grids, satellite, and point data. These bundles are designed to give an easy starting point for those new to McIDAS-V to create displays. These bundles can be removed through either the Local Favorite Bundles Manager or the General tab of the User Preferences window. For more information on these bundles, see the Main Toolbar page of the User’s Guide.

In addition to these bundles, there are a variety of zipped bundles (bundles that include data) that can be added through the Plugin Manager. Under the Sample Bundles tree in the Plugin Manager, there are five separate plugins for bundles that demonstrate many of the same features as the real-time Current WX bundles. Once these plugins are added and McIDAS-V is restarted, a toolbar button called Archive WX will be added to the Main Toolbar. This button behaves similarly to the Current WX button, where clicking Archive WX opens a dropdown containing any of the sample bundle plugins that were added. Once these bundles are added, they can only be removed through the Plugin Manager.

By default, adaptive resolution is disabled. In order to use adaptive resolution, it must be enabled through the Display Window tab of the User Preferences. Adaptive resolution is still under development so there may be bugs and there could implementation changes in the future. For this release, adaptive resolution is available in the Gridded Data, Point Observations, General Files/Directories, and the Under Development > Imagery – Satellite choosers.

Adaptive resolution is a feature designed to load high resolution data efficiently by obtaining and loading only the minimum amount of data needed to display all of the observable features in the given display size and geographic domain. If the domain is subsequently changed by using either Shift+left-click+drag or the Projections menu, adaptive resolution automatically reloads the data at a higher resolution (if available) if the user zoomed in to a more detailed view, or reloads the data at a lower resolution if the user zoomed out to a wider view.

Improved granule subsetting to aid in subsetting an entire granule.

Added support for ATMS (Advanced Technology Microwave Sounder) SDR data, including ATMS SDR and ATMS Remapped to CrIS SDR data. To display the Brightness Temperature field of this data, use the MultiSpectral display type, where the channel used for the display can be set through the Layer Controls. Also, additional fields will be visible including height, latitude, longitude, and different satellite angles which can be viewed with the standard Image Display. Also added support for Terrain Corrected Day Night Band data.

Added display units for many fields. For example, SVM16 Brightness Temperature now displays with units of degrees K instead of null. This is seen when the display is probed. Along with this, adding display units gives the ability to change the display unit used in the display through the Layer Controls.

Added the ability to aggregate different single-banded granules into one data source when the bands use the same geolocation and timesteps. For example, this allows users to use Shift+click to select single banded SVM03, SVM04, and SVM05 granules and click Add Source. This merges all of the SVM03, 04, and 05 data into one data source. This change applies to VIIRS SDR (SVI and SVM) as well as EDR granules. Note that SDR and EDR granules can not be merged into one data source even if they use the same geolocation granule.

Updated the VIIRS RGB formula from the Miscellaneous > VIIRS Formulas plugin to be able to handle single-banded granules. In previous versions of McIDAS-V, this formula would only work with multi-banded granules, where the Red, Green, and Blue components came from the same file. In addition, to get a full resolution display, a user now only has to subset a region for the Red component, and this will be carried over to Green and Blue. The VIIRS RGB formula can also now handle band subtractions for a color.

This is currently located in the Under Development list of choosers in the Data Sources tab of the Data Explorer and is available for user feedback through the McIDAS-V Support Forums. As the IDPS (Interface Data Processing Segment) begins to distribute new types of NPP data, we test it in McIDAS-V and make any necessary changes to be able to get the data to display.

Changed the name of the chooser from Polar Orbit Track chooser to the Satellite Orbit Track chooser. This change was made because tracks for other low earth orbit (LEO) satellites (such as TRMM) can be plotted, as well as geostationary satellites.

Added a valid timestamp macro that prints out the beginning and ending dates and times of the track plotted in the Main Display window. Also modified the Layer Controls tab of the Data Explorer to enhance functionality. This includes additional options to turn swath edge lines on/off, individually set font, style, and size of text for swath line times and ground station lines, options for setting line style of the track, swath edge, and ground station rings, the ability to plot multiple ground stations at once, and also the ability to specify your own ground station via lat/lon values.

This is currently located in the Under Development list of choosers in the Data Sources tab of the Data Explorer and is available for user feedback through the McIDAS-V Support Forums.

The NOAA Wind Profiler Network (NPN) Data Stream ended on August, 2014. With the stations no longer receiving data, the Point Observations > Wind Profiler chooser has been removed from the list of default choosers in the Data Sources tab of the Data Explorer. If access to this chooser is necessary, it can be added through the Plugin Manager window, under Data Sources > Wind Profiler Chooser. Once this chooser is added and McIDAS-V is restarted, the Wind Profiler chooser will again be available in the Data Sources tab of the Data Explorer. For more information on the discontinued wind profiler data, see the NOAA Profiler Network webpage.

The McIDAS-X Bridge Chooser has been fully deprecated from McIDAS-V. The chooser is no longer listed as a default chooser, and it is not available as a plugin.

Added the ability to add a unit to the color scale in the Main Display. A color scale can be added to the display through the Color Scale tab of the Properties window for the layer. In this tab, there is now a Visible checkbox that, when selected, will display the unit of your data on the color scale in the display.

Added a readout of wavelength when displaying multispectral data using the MultiSpectral display type. This wavelength readout will be at the bottom of the Layer Controls tab alongside the Band dropdown menu. This helps to make this display type more user-friendly.

Continued to add to the suite of fully supported Jython scripting tools introduced in McIDAS-V 1.2. The functions and methods in this suite can be used to load and display data, manipulate the display, and save the images. This allows the user to automatically process data and generate displays for web pages and other environments. This scripting can be done from the Jython shell within McIDAS-V, or from a Jython script that can be invoked as a command line argument. Please see Scripting for the list of supported functions, an example script, and links to various Java docs.

Since the release of McIDAS-V 1.3, there are new functions designed to work with ADDE data. These functions are:

makeLocalADDEEntry – Creates a local ADDE entry in the server table.

getLocalADDEEntry – Gets the descriptor for a local ADDE Entry.

listADDEImages – Lists data from an ADDE image server.

listADDEImageTimes – Lists available dates and times of data from an image server.

There is also a new version of getADDEImage that gives different output than the previous version.

Changed the Save Data window when saving a zipped bundle to make it easier to determine what data will get saved with your bundle. This is now done through radio buttons.

Reformatted the Layer Controls for the RGB Composite display. There is now an Apply button that will apply any changes to the red, green or blue minimum, maximum, or gamma values directly to the display without having to press Enter. There is also now an Apply to All Gamma Fields button that will apply a common gamma value to all colors.

Added the ability to set logging level in the Advanced tab of the User Preferences window. The logging level you select will determine how much information gets written out to your mcidasv.log file in your McIDAS-V directory. For more information about each of the logging levels and what they entail, please see the Log Level section of the Advanced Preferences page.

Reworked the Formula Editor to make it more intuitive to users. The Description field has moved out of the Advanced section of the Formula Editor, and into the top main section. The value in the Description field will be what is written out in the Field Selector as the name of the formula. The Name field of the Formula Editor has changed its name to ID, and is used when setting Parameter Defaults.

Added the ability to work with Suomi NPP data from NOAA CLASS that includes the data and geolocation within the same file. Non-consecutive granules can now be displayed, and granules can now be aggregated regardless of granule size. VIIRS SVI data from CLASS can now be displayed. Saving of both zipped and unzipped bundles containing NPP data is now supported.

There has been added functionality for working with VIIRS Cloud Mask products. If a GMODO-IICMO* product is loaded, there are various quality flag products included with the data. McIDAS-V now has the ability to determine which quality flag products are included with the data as well as what cloud mask fields can be produced from them. With cloud mask products, fields such as ‘Cloud Phase’, ‘Volcanic Ash’, ‘Dust’ and ‘Fire’ can be displayed.

There has been added functionality for working with VIIRS EDR (Environmental Data Records) products. These products include fields such as cloud heights, pressures, and temperatures, sea surface temperatures, and snow cover.

This is currently located in the Under Development list of choosers in the Data Sources tab of the Data Explorer and is available for user feedback through the McIDAS-V Support Forums. As the IDPS (Interface Data Processing Segment) begins to distribute new types of NPP data, we test it in McIDAS-V and make any necessary changes to be able to get the data to display.

McIDAS-V 1.3

The items below reflect the changes since the 1.2 release.

McIDAS-V 1.2

The items below reflect the changes since the 1.01 release.

McIDAS-V 1.01

The items below reflect changes since the 1.0 release.

Selected grid displays (contours, flow vectors, wind barbs) now have an option to perform smoothing functions on the grid. The GEMPAK 5-point (SM5S), 9-point (SM9S) and Gaussian Weighted Function (GWFS) smoothing functions have been implemented in McIDAS-V.