The FairCom RTG <file type> keyword did not take precedence over <file name> as stated in documentation.
The documentation, File Matching Precedence, says a specific type matching rule (i.e., I, R, L, or S) takes precedence over the * (unspecified) type. Based on that rule, it is expected that the following configuration file would cause a line sequential file named lineseq.txt to be handled by <redirinstance>:
<config>
<redirinstance lib="libcobrts64.so" func="EXTFH"> <!--Micro Focus-->
<file type="R"/> <!--relative files-->
<file type="S"/> <!--sequential files-->
<file type="L"/> <!--line sequential files-->
</redirinstance>
<instance> <!--ctreeRTG-->
<file/> <!--indexed files-->
<file name="lineseq.txt"/>
</instance>
</config>
Instead, the program failed because the line sequential file was handled by <instance>. Because priorities were not specified in the above ctree.conf, they were assigned automatically by FairCom RTG leading to unexpected results.
The logic has been modified to set priorities to -32767 only for the "name=* dir=* type=*" rule (which is the default file rule) and assign 0 to all others. Now, rules that specify only the file type (if different than "*") are given a priority of 0, as documented.