Give me your input on Data Request form
Moderator: Scott Waters
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Give me your input on Data Request form
http://www.naherp.com/test/request.html
It doesn't do anything yet. I figured I would get input on it before doing the backend programming for it. I have been wanting to do this for a while, to have one less area where myself or any future DC would need to be able to see what counties a restricted record is in. Requests are done at a county level, because if we allowed it at a lower level, say a bounding GPS box, it could be used to reveal localities for some species.
It doesn't do anything yet. I figured I would get input on it before doing the backend programming for it. I have been wanting to do this for a while, to have one less area where myself or any future DC would need to be able to see what counties a restricted record is in. Requests are done at a county level, because if we allowed it at a lower level, say a bounding GPS box, it could be used to reveal localities for some species.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Oh, I need to add options to request only records with vouchers. Do I need to add an option to request data with GPS? We have old records without it, but moving forward all will have it.
Re: Give me your input on Data Request form
A few comments:
First you linked to Article IX when you meant to link to Article XII (Doh!).
Add a box for affiliation under name.
You might want to state the max text that is allowed per box, if there is a max.
I suggest adding "Pleasegive us provide a description of your project and a reason for your request ."
"Describe any risk involved in releasing data to your project (eg. How will data be presented?, Will locality data be made public?, etc.)
I would add Time Frame, so people can request data by a range of years.
Do you want to add choices as to how data should be released eg. password protected access, CSV, KML, etc?
Should probable add a Database manager contact at the bottom of the form in case someone has questions.
First you linked to Article IX when you meant to link to Article XII (Doh!).
Add a box for affiliation under name.
You might want to state the max text that is allowed per box, if there is a max.
I suggest adding "Please
"Describe any risk involved in releasing data to your project (eg. How will data be presented?, Will locality data be made public?, etc.)
I would add Time Frame, so people can request data by a range of years.
Do you want to add choices as to how data should be released eg. password protected access, CSV, KML, etc?
Should probable add a Database manager contact at the bottom of the form in case someone has questions.
Re: Give me your input on Data Request form
psyon wrote:Oh, I need to add options to request only records with vouchers. Do I need to add an option to request data with GPS? We have old records without it, but moving forward all will have it.
FYI - short and bulk form still permit records to be entered without GPS....at least they will up until about 5 mins after Don reads this.
I dont think you need to add the GPS only option.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Short form shouldn't, but I'll look into bulk.spinifer wrote:FYI - short and bulk form still permit records to be entered without GPS....at least they will up until about 5 mins after Don reads this.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Doh! Typo on bulk form, should be fixed.
Re: Give me your input on Data Request form
Personally I am not a fan of the short form..
I like Nate's additions.
I think we should add an option box for non GPS records.. Many of those records have the locality field filled out, therefore might add value.
Might consider just adding the bylaw you reference at the bottom of the page?
Also you might consider a taxonomy notes place. In case there is taxonomy confusion and they want to chase down all possible matches?
Fundad
I like Nate's additions.
I think we should add an option box for non GPS records.. Many of those records have the locality field filled out, therefore might add value.
Might consider just adding the bylaw you reference at the bottom of the page?
Also you might consider a taxonomy notes place. In case there is taxonomy confusion and they want to chase down all possible matches?
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
My current form that I use to associate records with requests allows me to search if the record has specific locations. It checks if either the GPS coordinates are filled in, or if something is filled into the locale field.Fundad wrote:I think we should add an option box for non GPS records.. Many of those records have the locality field filled out, therefore might add value.
My only reason for not doing that, is that I don't want the bylaws quoted all over the place, and having to update them in many places if they ever change.Might consider just adding the bylaw you reference at the bottom of the page?
I debated using the type in field that I want to put on the record forms.Also you might consider a taxonomy notes place. In case there is taxonomy confusion and they want to chase down all possible matches?
Re: Give me your input on Data Request form
On the current form do they have a choice for that?My current form that I use to associate records with requests allows me to search if the record has specific locations. It checks if either the GPS coordinates are filled in, or if something is filled into the locale field.
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Well, the current form is just that they email me and tell me what they need. On that form I put up, nope, no option, I wasn't sure if I needed to add it since all records going forward will have them.
Re: Give me your input on Data Request form
It would be a sham to not include them, if they wanted those records?I wasn't sure if I needed to add it since all records going forward will have them.
Did we include the GPS less records in California's latest request? Or even offer them?
Same goes for the voucher less.
IMHO
Fundad
Re: Give me your input on Data Request form
My suggestion was that they get ALL the records (GPS and no GPS) with no option to exclude GPS-less records. If they find the records without GPS are of no value they can just throw them out. On the other hand, they might want to contact a record holder and get the GPS or a more exact location. Since going forward there will be fewer and fewer GPS-less records there is no need for the option.Fundad wrote:I think we should add an option box for non GPS records.. Many of those records have the locality field filled out, therefore might add value.
For vouchers, I think there should be a box that says "include vouchered records only". if they dont select that box, the get both vouchered and voucherless records.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
If you mean the latest turtle request, then they go only records that included GPS coordinates, and I included voucherless records as well. Their goal was to map locations where invasive and native turtles exist, so not having specific location didn't do them any good.Fundad wrote:Did we include the GPS less records in California's latest request? Or even offer them?
Re: Give me your input on Data Request form
Hmm,
So .25 miles north of street 5 in dilly creek, isn't good enough for a map?
Fundad
So .25 miles north of street 5 in dilly creek, isn't good enough for a map?
Fundad
Re: Give me your input on Data Request form
- We should add a box/line at the top for "Institution or Organization"
- Could we add a series of check boxes for the type of data they are requesting? Records with GPS, elevations, specific methods, etc. as well as an "select all" option? The reason I suggest this is that if someone just wants records of DORs for specific counties, there is no reason to send them all the data. It might make the data release simpler because it might not even need a vote.
I'm uncomfortable with the wording "Known Risks". I know what you are implying, but I'm not sure someone less familiar with our database and its history will be clear about what it means. Maybe something like:
Will the results or publication of your study disseminate this data to other parties?
If so, what type of data, and who would be the potential recipients of this data?
with the explanation....
There are some data in our database which are considered Sensitive by the contributors. Those contributors will want to know the potential extent of the data release that is being requested.
Chris
- Could we add a series of check boxes for the type of data they are requesting? Records with GPS, elevations, specific methods, etc. as well as an "select all" option? The reason I suggest this is that if someone just wants records of DORs for specific counties, there is no reason to send them all the data. It might make the data release simpler because it might not even need a vote.
I'm uncomfortable with the wording "Known Risks". I know what you are implying, but I'm not sure someone less familiar with our database and its history will be clear about what it means. Maybe something like:
Will the results or publication of your study disseminate this data to other parties?
If so, what type of data, and who would be the potential recipients of this data?
with the explanation....
There are some data in our database which are considered Sensitive by the contributors. Those contributors will want to know the potential extent of the data release that is being requested.
Chris
Re: Give me your input on Data Request form
Fundad wrote:Hmm,
So .25 miles north of street 5 in dilly creek, isn't good enough for a map?
Fundad
I have a few records in the database from the 80s that were listed like this. When I went back to GPS them, I found the roads either no longer existed or had changed names. So I can't find out where they were from.
Re: Give me your input on Data Request form
True, but that not the case all the time.. I have GPS markers on shopping malls, roads, and homes as well , because the herp was found there before the mall, road, or house was built.I have a few records in the database from the 80s that were listed like this. When I went back to GPS them, I found the roads either no longer existed or had changed names. So I can't find out where they were from.
I can't believe where not giving the requester the option.
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
If that is filled into the locale field, then it would be included as having a specific location.Fundad wrote:Hmm,
So .25 miles north of street 5 in dilly creek, isn't good enough for a map?
Fundad
Re: Give me your input on Data Request form
I am confused (what else is new ).If that is filled into the locale field, then it would be included as having a specific location.
So you did include records without GPS is the Locality field was field out in the last few requests?
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Crud... no... error in admin form... will fix now, and add additional records.Fundad wrote:So you did include records without GPS is the Locality field was field out in the last few requests?
Re: Give me your input on Data Request form
Have we told you, how much we appreciate your efforts? Ir doesn't go unnoticed.Crud... no... error in admin form... will fix now, and add additional records.
Thanks Don
Fundad
- Brian Hubbs
- Posts: 4735
- Joined: June 7th, 2010, 11:41 am
- Location: "Buy My Books"-land
Re: Give me your input on Data Request form
It could use a sub marginal discronificator allignment, but other than that I have no idea...
- Biker Dave
- Posts: 2869
- Joined: June 10th, 2010, 7:56 pm
- Location: Wittmann,AZ
Re: Give me your input on Data Request form
I think we should have a check box for records with GPS, records without GPS, and both. We can then use that info internally to determine necessity of GPS coordinate entries vs non . This will allow us to make better decisions regarding GPS at a later date if need be.
Just throwing that out as an idea...
Dave
Just throwing that out as an idea...
Dave
- Chris Smith
- Posts: 2291
- Joined: June 7th, 2010, 9:13 pm
- Location: Minnesota
Re: Give me your input on Data Request form
Biker Dave wrote:I think we should have a check box for records with GPS, records without GPS, and both. We can then use that info internally to determine necessity of GPS coordinate entries vs non . This will allow us to make better decisions regarding GPS at a later date if need be.
Just throwing that out as an idea...
Dave
I like this idea. We could also do this with via a follow-up e-mail /survey to the requester. We should always try to follow up with the requester to try to get a sense for what we could do better.
-Chris
Re: Give me your input on Data Request form
The GPS in smart phones is actually getting quite good, hell, probably better than the eTrex Legend I first started submitting records with.
I would not have a problem with requiring GPS for any new records.
I do think there should be a way for historic records to be entered without them.
I would not have a problem with requiring GPS for any new records.
I do think there should be a way for historic records to be entered without them.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
We already do require GPS. If you have notes that describe the location on old records, then you should be able find the location in Google maps to get the coordinates. If your notes aren't good enough for YOU to find a specific spot, then they will be worthless to anyone requesting the record.FunkyRes wrote:I would not have a problem with requiring GPS for any new records.
I do think there should be a way for historic records to be entered without them.
Re: Give me your input on Data Request form
Oh, OK - I missed when that changed.
As far as geo-referencing older records, sometimes geo-referencing them is bad.
Example, UCB MVZ had some black salamanders geo-referenced in Redding. Looking at verbatim locale, it said "10 miles from Redding" but did not give direction. In my opinion that kind of record should not be geo-referenced (looks like they used city hall) because it implies accuracy that isn't there. Should be left with just the "10 miles from Redding" and no geo-reference.
I hope people entering old records don't do meaningless geo-references just because it is required to enter the record, at least not without something in the comments to make it obvious.
As far as geo-referencing older records, sometimes geo-referencing them is bad.
Example, UCB MVZ had some black salamanders geo-referenced in Redding. Looking at verbatim locale, it said "10 miles from Redding" but did not give direction. In my opinion that kind of record should not be geo-referenced (looks like they used city hall) because it implies accuracy that isn't there. Should be left with just the "10 miles from Redding" and no geo-reference.
I hope people entering old records don't do meaningless geo-references just because it is required to enter the record, at least not without something in the comments to make it obvious.
Re: Give me your input on Data Request form
Based upon the years of conversations about these subjects, I always assumed there was a GPS and Voucher option.
Its an utter surprise to me that there wasn't those options already.
Had to throw that out there.. Mostly because I know it will bring a strong response from you.. Please ignore my
response.. (I truly don't want to debate it, I am in the GPS corner these days.).(I am down to under 270 gps less records, I hope to be done in a month or so)
Fundad
Its an utter surprise to me that there wasn't those options already.
Unless they were requesting a DOR count, historical county/State species recorded numbers, method type, or such..then they will be worthless to anyone requesting the record.
Had to throw that out there.. Mostly because I know it will bring a strong response from you.. Please ignore my
response.. (I truly don't want to debate it, I am in the GPS corner these days.).(I am down to under 270 gps less records, I hope to be done in a month or so)
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
From the records I have looked at for Iowa, many collections seem to put in GPS coordinates that point to the middle of the city that was referenced. Also, is that from the center of Redding, or 10 miles from the outskirts of town? That record by itself may be valuable in establishing that black salamanders exist within a 10 mile radius of Redding, but once there is any record with a more specific location in that area, then that record becomes worthless. What if that record is 10 miles east of Redding, but there is a record with GPS coordinates that was a around 10 miles North of Redding? Would people start assuming that the first record was just at the same location of the one to the North?FunkyRes wrote:Example, UCB MVZ had some black salamanders geo-referenced in Redding. Looking at verbatim locale, it said "10 miles from Redding" but did not give direction. In my opinion that kind of record should not be geo-referenced (looks like they used city hall) because it implies accuracy that isn't there. Should be left with just the "10 miles from Redding" and no geo-reference.
Huh?Based upon the years of conversations about these subjects, I always assumed there was a GPS and Voucher option.
Its an utter surprise to me that there wasn't those options already.
See my above example. If they were trying to get counts, it would sure be nice to be able to tell if two records reference the same animal or not. Look at all the people who complain that we need to keep the counts as accurate as possible. They say that you should only fill in the Qty field with your vouchered animals. They say that two people shouldn't both enter the same record to avoid having our counts look higher than they really are. Being able to see specific locations would sure help someone figure out which records are duplicates and which ones aren't.Unless they were requesting a DOR count, historical county/State species recorded numbers, method type, or such..
Re: Give me your input on Data Request form
Fundad, if I understand the release process correctly then anything the requester wants is a option....Don doesnt offer them specific choices, he give them what they ask for. If they request GPS only, he gives them GPS only, if they ask for Voucher only, he gives them voucher only. If nothing specific is ask for, then they get all the records.Based upon the years of conversations about these subjects, I always assumed there was a GPS and Voucher option.
Its an utter surprise to me that there wasn't those options already.
Having all these options is not necessary, leave specifics up to the requester, otherwise give them everything.
Re: Give me your input on Data Request form
I always thought there was a check box defining what records the requester wanted. We have had a ton of debates that have included what the requester's where choosing, and no one said otherwise.Quote:
Based upon the years of conversations about these subjects, I always assumed there was a GPS and Voucher option.
Its an utter surprise to me that there wasn't those options already.
Huh?
Nate Wrote:
We haven't been giving them everything.. If we are going to do that we should indicate which records dont have either the GPS or the vouchers... (In other words they should know that we haven't actually seen a voucher or that there isn't one for that persons record) You can't have a voucherless record written up, for example.Having all these options is not necessary, leave specifics up to the requester, otherwise give them everything.
Fundad
Re: Give me your input on Data Request form
How so? Don will have to confirm. But I am pretty sure we have given what was requested. If someone requested records from LA County, Don sent them ALL the records from LA County that were released, including GPS, No GPS, Voucher, No Voucher. Only if the requester specified a specific type of record (ie., I only want Vouchered) should they have been pared down. Otherwise what is the point of having GPS/Voucher-less records if they are not going to be sent?Fundad wrote:We haven't been giving them everything..
We do and they will. When they open the spreadsheet they will see that GPS or voucher is not provided. Whoever is writing up the record should (would) first inspect it and would see whether or not it includes a voucher. Taking additional steps is redundant.Fundad wrote:If we are going to do that we should indicate which records dont have either the GPS or the vouchers... (In other words they should know that we haven't actually seen a voucher or that there isn't one for that persons record) You can't have a voucherless record written up, for example.
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
Yes, I add records based on what they tell me. If they are looking for specific locations, they get only records with specific locations. If they say they want all records from an area, they get all records. When I send them the file, I instruct them to let me know if they need it in any additional formats, or anything more in it.
Re: Give me your input on Data Request form
See Don's post below for your answer..How so? Don will have to confirm. But I am pretty sure we have given what was requested. If someone requested records from LA County, Don sent them ALL the records from LA County that were released, including GPS, No GPS, Voucher, No Voucher.
It should be optional so they know what they are requesting and getting.. IMO.. People need to work on getting their GPS added too..Otherwise what is the point of having GPS/Voucher-less records if they are not going to be sent?
We will have to add naherp owned data as well at some point soon as well, I imagine.
GPS yes, but voucher? How will they know unless they look at the record (which is a monster task if requesting 100 or more records)We do and they will. When they open the spreadsheet they will see that GPS or voucher is not provided.
Fundad
Other then that, I don't really care.. I trust that Don will communicate these things to the requester to make sure they get the most bang for the buck with our records.
100 percent of my records will always have vouchers, and within a month or so all of my records will have GPS..
- Biker Dave
- Posts: 2869
- Joined: June 10th, 2010, 7:56 pm
- Location: Wittmann,AZ
Re: Give me your input on Data Request form
I know the records with vouchers have a little camera icon next to them when I look at mine in the db. I dont know if it transfers over to the data requests or not.
Dave
Dave
Re: Give me your input on Data Request form
Thats the point of requesting the data, so you can look at it. You HAVE TO look at the record. You CAN NOT assume that the data is correct, it must be double checked. It is a monster task, but any person who is serious about their research will do so.Fundad wrote:GPS yes, but voucher? How will they know unless they look at the record (which is a monster task if requesting 100 or more records)
I dont understand, how you dont understand, that GPS and Voucher-less being excluded from the request is already an option. All they have to do is ask for it.Fundad wrote:It should be optional so they know what they are requesting and getting..
Re: Give me your input on Data Request form
Is the voucher in the spreadsheet they are given? I dont "think" it is. Correct me if I am wrong. If the person that requested the data can "see"(without having to go naherp.com to look at the voucher) that the record doesn't have a voucher, then I am good. (see above )Thats the point of requesting the data, so you can look at it. You HAVE TO look at the record. You CAN NOT assume that the data is correct, it must be double checked. It is a monster task, but any person who is serious about their research will do so.
Sorry you don't understand how I dont understand.. Maybe you have seen the data that has been released in a request?I dont understand, how you dont understand, that GPS and Voucher-less being excluded from the request is already an option. All they have to do is ask for it.
Currently someone requesting data is just requesting the data. There is no check box options. And Don is giving out what he thinks they need or want.. I have yet to read a requesters request indicate "please include voucherless records" or the like?
Fundad
- Don Becker
- Posts: 3312
- Joined: June 7th, 2010, 4:21 am
- Location: Iowa
- Contact:
Re: Give me your input on Data Request form
http://www.naherp.com/user/view-data-re ... hp?dr_id=1
On our very first request, they specifically asked for vouchered localities only.
http://www.naherp.com/user/view-data-re ... hp?dr_id=2
On our second, they asked for both vouchered and unvouchered data.
http://www.naherp.com/user/view-data-re ... p?dr_id=10
This one only wanted vouchered data, and only ones with GPS
http://www.naherp.com/user/view-data-re ... p?dr_id=15
Vouchered only
http://www.naherp.com/user/view-data-re ... p?dr_id=16
Vouchered only
http://www.naherp.com/user/view-data-re ... p?dr_id=26
On that request, they specifically said they wanted ALL records, and that they would judge the merit of each one.
In all other cases, if they didn't specify, they got all records for the area they requested. The CSV file that I send by default, includes a field that lists URLs to all vouchers associated with the record. If that field is empty, the record isn't vouchered. They can easily tell if a record is vouchered or not by checking that column.
On our very first request, they specifically asked for vouchered localities only.
http://www.naherp.com/user/view-data-re ... hp?dr_id=2
On our second, they asked for both vouchered and unvouchered data.
http://www.naherp.com/user/view-data-re ... p?dr_id=10
This one only wanted vouchered data, and only ones with GPS
http://www.naherp.com/user/view-data-re ... p?dr_id=15
Vouchered only
http://www.naherp.com/user/view-data-re ... p?dr_id=16
Vouchered only
http://www.naherp.com/user/view-data-re ... p?dr_id=26
On that request, they specifically said they wanted ALL records, and that they would judge the merit of each one.
In all other cases, if they didn't specify, they got all records for the area they requested. The CSV file that I send by default, includes a field that lists URLs to all vouchers associated with the record. If that field is empty, the record isn't vouchered. They can easily tell if a record is vouchered or not by checking that column.
Re: Give me your input on Data Request form
Thanks for the clarification Don..
Fundad
Fundad
Re: Give me your input on Data Request form
Yes, thank you Don.