Appendix 2.1 Medits Steering Committee. Meeting report
Pisa, the 18th March 1998
The Medits Steering Committee has met in
Pisa the 18th March 1998 with the participants named below:
BERTRAND Jacques (chairman) |
France |
GIL DE SOLA Luis |
Spain |
TSERPES George |
Greece |
TURSI Angelo |
Italy |
SOUPLET Arnauld |
France |
RELINI Giulio |
Italy |
FIORENTINI Loris |
Italy |
CERVEK
Stanko |
Slovenia |
JUKIC-PELADIC Stjepan |
Croatia |
PAPACONSTANTINOU Costas |
Greece |
POLITOU Chrissi-Yianna |
Greece |
KALLIANIOTIS Argyris |
Greece |
ARDIZZONE Giani |
Italy |
LEVI Dino |
Italy |
The
chairman has opened the meeting and made the apologies for some colleagues who
intended to participate but were unable to join the meeting.
The
meeting has progressed on the agenda presented below.
Thanks
to the efficient contribution of each of the partners, the common final report
has been prepared by the 15th of January 1998. This provisional report has been
sent by the co-ordinator to the Commission the 23rd of January 1997. For the
time being, we are still waiting for the approval of this document. It has
been reminded that each of the main
partners (Spain, Italy and Greece) has to sent to the Commission its own final
report to complete the project.
During
the future Medits surveys, the
sea temperature will be recorded during each haul. As a conclusion of a survey
on the available devices, three systems have been preselected from a list of 13
proposals (Seamon CDT by Hugrun, Iceland; P2TLL600 by Micrel, France and
Minilog TDR by Vemco, Canada). Finally, the Steering Committee has decided to
adopt the Minilog TDR by Vemco. The co-ordinators have been invited to provide
this equipment for each of the vessels involved in the Medits ‘98 survey.
Contacts
have been managed by the SIBM with Malta for an enlargement of the Medits ‘98 survey in the Malta area.
For the time being, these relationships have not been concluded.
Some
changes in the vessels used for the survey will occur in 1998. The commercial
vessels used in the M4 area (Italy and Albania) and in the M5 area (Italy,
Croatia and Slovenia) will be replaced by new ones. In Greece, 18 stations will
be added in the Ionian Sea to improve the sampling scheme in this area. To
limit the duration of the survey, three commercial vessels will be used in
Greece. They will be managed respectively by the NCMR (Athens) for the Ionian Sea
and the Argosaronic Gulf, by the FRI (Kavala) for the northern Aegean Sea and
by the IMBC (Iraklion) for the southern Aegean Sea. These vessels will be
different from those used during the previous surveys.
The
Steering Committee has reminded its will to favour the exchanges of scientists
aboard the vessels and in the laboratories within the programme. The
organisation of such mobility will be left to the initiative of the
co-ordinators.
The
same schedule as for the 1997 survey is foreseen in 1998. The transfert of the
data from the regional teams to the co-ordinator should be finished by the end
of September 1998 and a general meeting will be held in November 1998.
The
temperatures which will be recorded at each haul will be included in additional
files. C.Y. Politou has been invited to propose a format for these new files,
referring to the format available from the Minilog recorder. It has been expected
that this proposal will be available by the 15th of April 1998.
For the
time being, the FM list contains more than 600 species. The Steering Committee
has considered that the aim of the surveys was not to go towards an exhaustive
analysis of the contains of the hauls. He has decided that only species which
should really offer an interest related to fisheries in at least one sub-area
will be added in the list from now.
Generally,
the quality of the basic data files sent by the teams involved in the Medits programme to be included in the
common data bank has been strongly improving from one year to the next.
Nevertheless, during the validation of the Medits
‘97 data, it has been found that some errors which could be identified by a
routine checking were still remaining in the exchange files. For this reason,
A. Souplet has included a complementary checking in the CHECKMED program. A new
version of this program (CHKMED2) has been presented to the Steering Committee
(appendix 2.1.1). A. Souplet will send this software by e-mail to each of the
Steering Committee members before the beginning of the Medits ‘98 survey.
The
co-ordinator of the project, C.Y. Politou, has informed the SC that a first
version of the software has been sent for validation to the participants in the
project (cf. the Madrid meeting report). The conclusions of this analysis were
waited by the end of March 1998.
The
development of the software has been continued during the last few months. A
demonstration of the present version of this software has been done to the SC
by Iannis Dankos during the present meeting.
The
present stage of the project aims to develop standard statistical analyses.
The
co-ordinator of the project has drawn the attention of the SC on her worries
about the development of the interfaces between the Medits data files and GIS as well as statistical packages. It
has been expected that this question would be solved during the symposium just
following the present meeting, as this work will be presented as a poster.
F.
Corsi has reminded that the Web site is open and accessible to the
participants. For the time being, it contains the presentation of the programme
and partnerships.
As the
main contents of the MDBS software should be available by the next Autumn, the
MDBS co-ordinator has been invited to organise a test of its ability for the
management of the data in ‘’real time’’ with the data sets which will be produced
during the next Medits survey.
The
co-ordinator has informed the SC that he has received two requests for an
access to the Medits data. The SC
has reminded his wish for a as much large as possible opening of the Medits data base to the scientific
community, but taking into account the priority for a first elaboration by the
scientists who have contributed in the production of the data bank. As it has
been begun through the symposium (18-21 March 1998), the scientists involved in
the programme are incited to progress in that way as fast as possible to permit
to go to the next stage which will be an enlargement of the access to the Medits data for a larger number of
scientists. In particular, the urgent need for common elaborations of the data
at the full Medits scale, for
instance by species groups, has been highlighted. New working propositions will
be proposed to the Co-ordination Committee for acceptance. This procedure
applies for other working groups (ICES, GFCM, etc.).
One of
these requests was from J. Lleonart, as co-ordinator of the Llucet project. By
this request, J. Lleonart has asked for an access to all the Medits data concerning the hake along
the Spanish, the French and the western Italian coasts. As scientists from
France and north-western Italy are partners in both the Medits and the Llucet project, the SC has strongly encouraged
the utilisation of the Medits
data on hake from these areas by the Llucet project. The corresponding data
will be given to the Llucet programme by the concerned regional co-ordinators.
The situation in Spain is quite different because no one scientist from IEO is
involved in the both programmes. For the Spanish area, the SC has considered
that the management of this question should be done through direct contacts
between the responsible scientists of IEO and CSIC-ICM.
The
other request was from J. Caddy (FAO) who has asked for summarized total
biomass by species in the different statistical areas. The SC has underlined
that the publication of the basic results obtained from the Medits surveys, as it is done in the
annual reports, has to be considered as a high priority. This kind of document
would satisfy different requests such as the present one. The co-ordinator has
been invited to prepare a proposal on this purpose. The SC has considered that
a first spreading of such information should be managed during this year.
Closing
the session, the co-ordinator has thanked Franco Biagi and the CIBM for the
quality of accommodation provided to the group during the meeting. He had
thanked the participants for their useful contribution in the meeting.
___
chkmed2: a second version of the software to check
the Medits data files
by Arnauld Souplet
IFREMER - Sète
March 1998
By
writing the CHECKMED program (A. Souplet, 1995), it was expected that most of
errors in the Medits data files
could be pointed out. Nevertheless it appeared after the 1996 and 1997 surveys
that some errors can remain, for example: file not sorted as described below,
several lines (one by sex) for the same species in the same haul in the TB
file, cross-checking between TB and TC files not made.
To
avoid this kind of errors, a second version as been written whose name is CHKMED2. It does basically the same
things as the CHECKMED one with some minor amendments and includes now the
checking of the above mentionned errors.
To
correctly operate the programs, it is
essential that the TA, TB and TC files are sorted as indicated below.
The files can be sorted using any commercial software (Excelâ, Dbaseâ, etc ...)
Sorted
by:
HAUL NUMBER (position 28-30 in the file)
Sorted
by:
HAUL NUMBER (position 11-13)
GENUS-SPECIES (17-23)
Sorted
by:
HAUL NUMBER (position 11-13)
GENUS-SPECIES (16-22)
WEIGHT OF THE FRACTIONS (PFRAC ; 24-29)
SEX (36-36)
LENGTH CLASS (43-46)
From
the previous version (dated from October 1995), the package has been extended
to include 12 countries/areas, 200 hauls in each, 800 species in the FM list
and 31 reference species. It is divided into 1 batch file, 6 programs and 4
reference files. These are:
CHKMED2.BAT |
Beginning
of the checking procedure |
CHKMED2D.EXE |
Input
various informations used by the other programs |
CHKMED2A.EXE |
Checks TA |
CHKMED2B.EXE |
Checks TB |
CHKMED2C.EXE |
Checks TC |
CHKMED2F.EXE |
Results
of the individual file checking |
CHKMED2X.EXE |
Cross-checking
of TB and TC |
BATyy.CHK |
List of
vessels (yy = year) |
ESPECEyy.CHK |
List of
species with faunistic category and length code |
LATLON.CHK |
Limits of
latitudes and longitudes for each country/area |
MINMAX.CHK |
Minimum
and maximum length ever seen for each species (31) of the reference list |
In
addition the package uses the reference file ESPECE.REF used in the INDMED program.
All
these files must be on the same directory together with the 3 sorted data files
to be checked: TAccyyaa.TXT, TBccttaa.TXT and TCccyyaa.TXT in which cc =
country code on 2 characters, yy =
year and aa = area code on 2
characters.
As
output, the programs create 3 files which have the same name as the data file.
The file name extension .TXT is
replaced by .VER (for the French
"vérification", i.e. "checking"). In these files clear
error or warning messages are written. In the case of several records for a
given species in a given haul, the program creates a file named TBccttaa.MUL in which the numbers of
records for the same species in the same haul are given.
This
file contains, for each country/area the 2 characters country and area codes
and the 3 characters code for the vessels. It might be changed each year if
necessary. Its structure for 1997 is shown below:
ES__COR
FR__LEU
ITM1FRP
ITM2NUS
ITM3SAN
ITM4BIM
ITM5PRI
SL__PRI
HR__PRI
AL__BIM
GRG1PAR
GRG2IRO
It
contains the Rubbin code, the faunistic category (CATFAU) and the length code
(CODLON) for all species refered to in the LISTFM file used for the relevant
survey. An example of this file is given below:
ABRAVER C0
ACANEXI Bm
ACANPEL Bm
ACATPAL A0
AEQUOPE D0
ALEPROS A0
ALLOMED C0
It
contains the minimal and maximal latitudes an longitudes for each country/area.
This file might also be changed if necessary. Its main use is to avoid
important typing errors, which, for example, could lead us to have trawled
under the Tour Eiffel !. This file is shown below (the negative value for the
longitude indicates a west longitude).
ES__3555.16-516.154223.75
339.29
FR__4130.20
304.944328.12 945.35
ITM14052.88
746.954419.861327.98
ITM23830.56
745.574119.241001.00
ITM33522.591112.974102.211610.67
ITM43644.141511.254206.391846.59
ITM54159.391218.794538.981734.61
SL__4533.731331.024535.391336.74
HR__4216.241310.024531.531751.70
AL__4025.131846.914141.201924.63
GRM13810.162237.994051.942609.35
GRM2
35.27 25.583900.102747.99
This
file contains the minimum and maximum length ever seen in Medits for the 31 species of reference.
It might obviously been modified if an individual outside these limits is
reported but it can be useful to detect enormous typing errors such as a hake
of 3 m instead of 30 cm. The lengths in the file are given in millimeters:
CITHMAC 45
330
EUTRGUR 40
370
HELIDAC 40
310
LEPMBOS 40
385
LOPHBUD 40
870
LOPHPIS 30 1120
MERLMER 10
840
MICMPOU 20
410
MULLBAR 20
370
MULLSUR 60
370
PAGEACA 25
330
PAGEBOG 35
535
PAGEERY 35
440
SPARPAG 30
510
PHYIBLE 30
565
RAJACLA 100 970
SOLEVUL 80 435
SPICFLE 40 240
TRACMED 20 435
TRACTRA 30 460
TRISCAP 20 285
ZEUSFAB 45 620
ARITANT 10 64
ARISFOL 10 40
NEPRNOR 10 41
PAPELON 10 47
ELEDCIR 10 295
ILLECOI 13 250
LOLIVUL 10 440
OCTOVUL 30
250
SEPIOFF 15
185
By
typing CHKMED2, the user will call
the batch file shown below:
ECHO OFF
IF EXIST CHKMED2.DAT DEL CHKMED2.DAT
IF NOT EXIST CHKMED.DAT GOTO POINT1
DEL CHKMED.DAT
:POINT1
CHKMED2D
CHKMED2A
CHKMED2B
IF EXIST CHKMED2.DAT GOTO FIN
CHKMED2C
CHKMED2F
:FIN
This
batch file calls the first 5 programs in the right order. The first one (CHKMED2D) asks the user for the Country
code, the Area code and the Year. The file names to be checked are build from
these data and stored in the CHKMED.DAT
file, together with the number of errors encountered in each file (0 at the
beginning of course).
The
program first checks that the hauls are in numerical order, which means that at
least this file has been sorted in the duty way (that does not prevent the user to check that the other files have been
sorted). If not the following message is display and the program stops.
***************************************************************************
*
*
* THE "TA" FILE IS NOT SORTED BY
HAUL NUMBER. YOU HAVE TO SORT IT *
* TO DO THAT REFER TO THE
"CHECKME2.DOC" DOCUMENT *
*
*
* AT THE SAME
TIME CHECK WHETHER OR NOT THE "TB" AND "TC" FILES ARE
SORTED*
* AS DECRIBED IN THE SAME
DOCUMENT *
*
*
***************************************************************************
If the
"TA" file appears to have been correctly sorted, the program checks
that each haul, from the first to the last, appears once and only once in the
file. Thereafter it checks the file line by line. The following checkings are
performed:
TYPENR |
TA |
PAYS |
Correctly
typed |
BATEAU |
The same
as in the reference file |
ENGIN |
GOC73 |
GREEMENT |
GC73 |
PANNEAUX |
WHS8 |
AN |
The
correct year as given by the user in the first program |
MOIS |
April to
August |
JOUR |
1 to 30
for April and June ; 1 to 31 for May, July and August |
FERCHA |
S or C |
QUADEB QUAFIN |
1 for
France, Italy, Slovenia, Croatia, Albania and Greece ; 1 or 7 for Spain |
LATDEB LGNDEB LATFIN LGNFIN |
They must
be within the limits referred to in the reference file |
PRODEB PROFIN |
The
difference between these two depths is calculated. If it is larger than 20%,
a warning message is written in the output file together with the two depths. |
HDEB HFIN |
HDEB must
be less than HFIN |
DUREE |
It must
be equal to those calculated from the reported times |
VALID |
V or I |
PARCOU |
R or N |
ESPENR |
0 to 4 |
DIST |
It must
be equal (within a 10% limit) to those calculated from the reported positions[1] |
OUVER |
1 to 4 m |
ECAIL |
5 to 25 m |
PRGEO |
M or E |
LONBRA |
100
meters down to 200 m depth, 150 meters downward[2] |
LONFUN |
100 to
2200 m |
DIAFUN |
14 to 30
mm |
The
program first reads the valid hauls in the TA file and checks that all these
hauls are present in the TB file. It asks the user whether or not he wants to
check that the reported species are in the FM list. If not, there will be no
error message if a species does not belong to the list[3]. Thereafter it checks that it is
only one line by species and by haul. If not, the following message is
displayed and the program stops.
***************************************************************************
*
*
* THERE IS SOME MULTIPLE RECORDS FOR THE SAME SPECIES
IN THE SAME HAUL *
* YOU CAN CHECK THEM IN THE FILE
"Tbccttaa.MUL" *
*
*
* WHEN ALL THESE ERRORS WILL BE CORRECTED, YOU MUST
RUN THE WHOLE *
* PROGRAM AGAIN TO DETECT OTHER POSSIBLE ERRORS IN THE
"TB" FILE *
*
*
* FURTHERMORE YOU SHOULD NOTE THAT IN THE CASE OF
THESE ERRORS *
* THE "TC" FILE IS NOT YET CHECKED *
* *
***************************************************************************
If this
errors do not occur, the file is checked line by line. The following checkings
are performed:
TYPENR |
TB |
PAYS |
Correctly
typed |
BATEAU |
The same
as in the reference file |
AN |
The
correct year as given by the user in the first program |
FERCHA |
S or C |
PARTIT |
S if
FERCHA = S ; A, M or P if FERCHA = C |
SPECIES |
Checks
whether or not the reported species is in the FM list |
CATFAU |
Must be
the same as in MEDIESP.DAT file for the given species |
PTOT |
Must not
be 0 |
NBTOT |
Must not
be 0 but equal to NBFEM+NBMAL+NBIND |
In
addition, the program checks that there are only allowed characters[4] in the file. In case of a forbidden
character, the program stops and the number of the line containing a forbidden
character is displayed on the screen.
The
program first reads the valid hauls in the TA file and checks that all these
hauls are present in the TC file. If not, it is not necessarily an error
because it could happen that there is no reference species in a given haul.
Thereafter it checks the file line by line. The following checkings are
performed:
TYPENR |
TC |
PAYS |
Correctly
typed |
BATEAU |
The same
as in the reference file |
AN |
The
correct year as given by the user in the first program |
FERCHA |
S or C |
PARTIT |
S if
FERCHA = S ; A, M or P if FERCHA = C |
SPECIES |
Checks
whether or not the reported species is in the FM list |
CODLON |
Must be
the same as in MEDIESP.DAT file for the given species |
PECHAN |
Must be
less than or equal to PFRAC |
SEXE |
F, M, I
or N |
MATUR |
0-4 |
CLALON |
Must be
within the limits defined in MINMAX.CHK file[5] |
NBLON |
Must be
better less than 500[6] |
Once
again the program checks that there are only allowed characters[7] in the file. In case of a forbidden
character, the program stops and the number of the line containing a forbidden
character is displayed on the screen.
This
program displays whether or not each file is correct and, if not, the number of
errors which remains in each and the name(s) of the file(s) in which these
errors are listed. Thereafter, it diplays the following important message (the first lines are only an example in the case
of three correct file):
***************************************************************************
"TA" FILE IS CORRECT
"TB" FILE IS CORRECT
"TC" FILE IS CORRECT
EVEN IF ALL
YOUR FILES ARE INTRINSICALLY CORRECT, DONT FORGET TO RUN
THE
"CHKMED2X" PROGRAM TO MAKE THE CROSS-CHECKING OF THE "TB"
AND "TC" FILES
THANK YOU FOR
YOU COOPERATION
ARNAULD
***************************************************************************
This
program has to be run only after that the 3 data files have been checked and
corrected indicidually. It is called by typing CHKMED2X. The checking is performed only on the reference species
because to make it for all species in the FM list would need a huge memory,
which is not currently available on PC's. For the other species, the attention
of the users is drawn on the fact that some mistakes can remain in the data
files, due to no control on that species. For each haul and reference species
the program checks that:
· PTOT reported in the TB file is equal to the sum of the different (if any) PFRAC's in that haul and for that species.
· NBFEM, NBMAL and NBIND reported in the TB file are equal to the sum of all individuals in that haul for that species and that sex, corrected by the ratio PFRAC/PECHAN.
The
output file has the following name: TXccyyaa.VER
with cc = country code, yy = year, aa = area code. The program advices you how many errors have been
detected or if the two files are consistent. In the later case, it give you its
congratulations on behalf of myself.
All
these programs can be operated alone, without running the whole software. This
is useful to make the user sure that no error remains in the file and it can be
done very easily by typing the program's name without modifying the CHKMED.DAT
file.
This
checking procedure is NOT a correction procedure. The cases of errors are so
numerous and so various (as it has been seen !) that it seems rather impossible
to write such a procedure. It is
everybody's duty to correct, if necessary, his own files.
The
author thinks (once more, maybe the last !) that the majority of the possible
errors has been taken into account. Nevertheless, should the users note some
omission(s) and/or bug(s) in this package, they are invited to contact him as
soon as possible.
Thank you again for your co-operation.
[1] If PARCOU is reported as
rectilinear, the output message can be considered as an error message. In the
case of a not rectilinear course, it is only a warning message.
[2] A bad bridle length message is
written together with the corresponding depth
[3]
This option is useful to detect typing errors in the species name. On
the other hand, if new species were added to the FM list, it would produce a
lot of unuseful errors. My suggestion is to use this option only once to detect
typing errors. Once these errors have been corrected, it could be advisable to
run the program again without this option.
[4] In TB file the allowed characters
are: 0-9, A-Z, space
[5] This is only a warning intending to
prevent enormous typing errors
[6] Only a warning again. People are
allowed to measure up to 999999 individual in the same length class, even if it
is not advisable at all and if it is recommended not to measure more than 100
individuals in the same sub-sample.
[7] In TC file the allowed characters
are: 0-9, A-Z, m, space