<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I have been on conference committee for almost a decade, I can’t recall us ever having more than 4 proposals for the global FOSS4G. Each year there are different factors that influence our choices, I don’t recall a year when there was much doubt about who we should select. A predetermined marking system would not make our job any easier it would just lead to endless debate about the relative weighting of each of the factors<br class=""><div class="">
<meta charset="UTF-8" class=""><div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="text-align: start; text-indent: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><span class="Apple-style-span" style="border-collapse: separate; font-variant-ligatures: normal; font-variant-east-asian: normal; font-variant-position: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; widows: 2; border-spacing: 0px;"><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">______<br class="">Steven<br class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Unusual maps in strange places - <a href="http://mappery.org" class="">mappery.org</a><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><br class=""></div><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Subscribe to my weekly “<a href="http://eepurl.com/dKStT-/" class="">Maps in the Wild</a>” newsletter</div></span></div></div></div>
</div>
<div><br class=""><blockquote type="cite" class=""><div class="">On 13 Jan 2022, at 15:22, María Arias de Reyna <<a href="mailto:delawen@gmail.com" class="">delawen@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">On Thu, Jan 13, 2022 at 1:13 PM Jonathan Moules via Discuss<br class=""><<a href="mailto:discuss@lists.osgeo.org" class="">discuss@lists.osgeo.org</a>> wrote:<br class=""><blockquote type="cite" class="">I don't think there's any need to reinvent the wheel here; a number of open-source initiatives seem to use scoring for evaluating proposals. Chances are something from one of them can be borrowed.<br class=""><br class="">Apache use it for scoring mentee proposals for GSOC: <a href="https://community.apache.org/mentee-ranking-process.html" class="">https://community.apache.org/mentee-ranking-process.html</a><br class=""><br class="">Linux Foundation scores their conference proposals for example: <a href="https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/program/scoring-guidelines/" class="">https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/program/scoring-guidelines/</a><br class=""></blockquote><br class="">Am I understanding it wrong or this is to accept talk proposals, not<br class="">conference proposals?<br class=""><br class="">Scoring a contractor for a well defined project (as you pointed public<br class="">administrations do), choosing the right person for a specified job, or<br class="">deciding if a talk deserves to be in a schedule is more or less "easy"<br class="">compared to decide who is hosting a conference.<br class=""><br class="">If you want to propose a draft of score requirements for FOSS4G, I<br class="">think it would be interesting to go through them and try to come up<br class="">with something. Even if the scoring is not binding, it may help future<br class="">proposals see what is the path.<br class=""><br class="">My only "but" with this system (which I use almost always when I have<br class="">to review anything and I intended to use for this FOSS4G voting) is<br class="">that it is hard to come up with an objective system that counts all<br class="">the variables. And if the score does not match the final decision, it<br class="">may be difficult to process.<br class=""><br class="">I have been on the GSoC as mentor with the ASF and true, we have a<br class="">ranking process, but it helped us mostly to order the candidates and<br class="">reject those that deviate too much. The final decision was not a clear<br class="">numeric decision. When the difference is small, you do have to<br class="">consider other things. And from what I have seen these past few years<br class="">on FOSS4G, either there is one candidate that outshines obviously, or<br class="">the difference is really small between candidates and it comes down to<br class="">things that may not be even defined on the RFP.<br class=""><br class="">And there's things you have to consider that a generic scoring system<br class="">can't help you with. We used this system in FOSS4G 2021 to decide<br class="">which talks to accept on the conference, where the community voting<br class="">had a strong weight but was not binding. And we had to make some<br class="">exceptions with good talks that were experimental but didn't get a<br class="">good score and objectively numerically they were rejected. We also had<br class="">to reject some duplicated talks that had a high score but we couldn't<br class="">argue both were accepted. Which one to reject? Usually the one that<br class="">had a speaker with more talks. But what if both have a speaker with no<br class="">more talks? That's something you have to check case by case.<br class=""><br class="">Which leads us that with the scoring there is less room for<br class="">experimentation because the candidates will focus on getting high<br class="">scores on specific questions. Not on offering what is their best. For<br class="">example, the proposal we made for FOSS4G Sevilla 2019 in a pirate<br class="">amusement park to celebrate Magallanes... no score could have<br class="">predicted that.<br class=""><br class="">So I may agree on scoring, not on binding scoring.<br class=""><br class="">But first we need some draft to work on to score proposals :)<br class="">_______________________________________________<br class="">Conference_dev mailing list<br class=""><a href="mailto:Conference_dev@lists.osgeo.org" class="">Conference_dev@lists.osgeo.org</a><br class="">https://lists.osgeo.org/mailman/listinfo/conference_dev<br class=""></div></div></blockquote></div><br class=""></body></html>