formal_review_process.htm 14 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
  2. <html>
  3. <head>
  4. <meta name="generator" content=
  5. "Microsoft FrontPage 5.0">
  6. <meta http-equiv="Content-Type" content=
  7. "text/html; charset=windows-1252">
  8. <meta name="GENERATOR" content="Microsoft FrontPage 5.0">
  9. <meta name="ProgId" content="FrontPage.Editor.Document">
  10. <title>Boost Formal Review Process</title>
  11. <style type="text/css">
  12. @import ../boost.css
  13. .first {
  14. margin-top: 0 }
  15. .last {
  16. margin-bottom: 0 }
  17. div.attention, div.caution, div.danger, div.error, div.hint,
  18. div.important, div.note, div.tip, div.warning, div.admonition {
  19. margin: 2em ;
  20. border: medium outset ;
  21. padding: 1em }
  22. div.attention p.admonition-title, div.caution p.admonition-title,
  23. div.danger p.admonition-title, div.error p.admonition-title,
  24. div.warning p.admonition-title {
  25. color: red ;
  26. font-weight: bold ;
  27. font-family: sans-serif }
  28. div.hint p.admonition-title, div.important p.admonition-title,
  29. div.note p.admonition-title, div.tip p.admonition-title,
  30. div.admonition p.admonition-title {
  31. font-weight: bold ;
  32. font-family: sans-serif }
  33. </style>
  34. </head>
  35. <body bgcolor="#FFFFFF" text="#000000">
  36. <table border="1" bgcolor="#007F7F" cellpadding="2">
  37. <tr>
  38. <td bgcolor="#FFFFFF"><img src="../boost.png" alt=
  39. "boost.png (6897 bytes)" width="277" height="86"></td>
  40. <td><a href="../index.htm"><font face="Arial" color=
  41. "#FFFFFF"><big>Home</big></font></a></td>
  42. <td><a href="../libs/libraries.htm"><font face="Arial" color=
  43. "#FFFFFF"><big>Libraries</big></font></a></td>
  44. <td><a href="../people/people.htm"><font face="Arial" color=
  45. "#FFFFFF"><big>People</big></font></a></td>
  46. <td><a href="faq.htm"><font face="Arial" color=
  47. "#FFFFFF"><big>FAQ</big></font></a></td>
  48. <td><a href="index.htm"><font face="Arial" color=
  49. "#FFFFFF"><big>More</big></font></a></td>
  50. </tr>
  51. </table>
  52. <h1>Boost Formal Review Process</h1>
  53. <div class="admonition-note admonition">
  54. <p class="first admonition-title">Before Requesting a Formal Review</p>
  55. <p class="last"><b>Read and follow the Boost <a href=
  56. "submission_process.htm">submission process</a>.</b>&nbsp; There are at
  57. least four steps a library author must take before a formal review is
  58. requested.</p>
  59. </div>
  60. <p><a href="#Introduction">Introduction</a><br>
  61. <a href="#Comments">What to include in Review Comments</a><br>
  62. <a href="#Results">Results</a><br>
  63. <a href="#Review_Manager">Notes for Review Managers</a><br>
  64. <a href="#Submitters">Notes for Library Submitters</a><br>
  65. <a href="#Wizard">Review Wizard</a><br>
  66. <a href="#Fast-Track">Fast Track Reviews</a></p>
  67. <h2><a name="Introduction" id="Introduction">Introduction</a></h2>
  68. <p>Proposed libraries are accepted into Boost only after undergoing a
  69. formal review, where Boost mailing list members comment on their evaluation
  70. of the library.</p>
  71. <p>The final "accept" or "reject" decision is made by the <a href=
  72. "#Review_Manager">Review Manager</a>, based on the review comments received
  73. from boost mailing list members.</p>
  74. <p>Boost mailing list members are encouraged to submit Formal Review
  75. comments:</p>
  76. <blockquote>
  77. <ul>
  78. <li>Publicly on the mailing list.</li>
  79. <li>Privately to the Review Manager.</li>
  80. </ul>
  81. </blockquote>
  82. <p>Private comments to a library submitter may be helpful to her or him,
  83. but won't help the Review Manager reach a decision, so the other forms are
  84. preferred.</p>
  85. <h2>What to include in Review <a name="Comments" id=
  86. "Comments">Comments</a></h2>
  87. <p>Your comments may be brief or lengthy, but basically the Review Manager
  88. needs your evaluation of the library.&nbsp; If you identify problems along
  89. the way, please note if they are minor, serious, or showstoppers.</p>
  90. <p>The goal of a Boost library review is to improve the library through
  91. constructive criticism, and at the end a decision must be made: is the
  92. library good enough at this point to accept into Boost? If not, we hope to
  93. have provided enough constructive criticism for it to be improved and
  94. accepted at a later time. The Serialization library is a good example of how
  95. constructive criticism resulted in revisions resulting in an excellent
  96. library that was accepted in its second review.</p>
  97. <p>Here are some questions you might want to answer in your review:</p>
  98. <ul>
  99. <li>What is your evaluation of the design?<br></li>
  100. <li>What is your evaluation of the implementation?<br></li>
  101. <li>What is your evaluation of the documentation?<br></li>
  102. <li>What is your evaluation of the potential usefulness of the
  103. library?<br></li>
  104. <li>Did you try to use the library?&nbsp; With what compiler?&nbsp; Did
  105. you have any problems?<br></li>
  106. <li>How much effort did you put into your evaluation? A glance? A quick
  107. reading? In-depth study?<br></li>
  108. <li>Are you knowledgeable about the problem domain?</li>
  109. </ul>
  110. <p>And finally, every review should answer this question:<br></p>
  111. <ul>
  112. <li>Do you think the library should be accepted as a Boost library?&nbsp;
  113. Be sure to say this explicitly so that your other comments don't obscure
  114. your overall opinion.</li>
  115. </ul>
  116. <p>Many reviews include questions for library authors. Authors are
  117. interested in defending their library against your criticisms; otherwise
  118. they would not have brought their library up for review. If you don't get a
  119. response to your question quickly, be patient; if it takes too long or you
  120. don't get an answer you feel is sufficient, ask again or try to rephrase the
  121. question. Do remember that English is not the native language for many
  122. Boosters, and that can cause misunderstandings.<br>
  123. <br>
  124. E-mail is a poor communication medium, and even if messages rarely get lost
  125. in transmission, they often get drowned in the deluge of other messages.
  126. Don't assume that an unanswered message means you're being ignored. Given
  127. constructively, criticism will be taken better and have more positive
  128. effects, and you'll get the answers you want.</p>
  129. <h2><a name="Results">Results</a></h2>
  130. <p>At the conclusion of the comment period, the Review Manager will post a
  131. message to the mailing list saying if the library has been accepted or
  132. rejected.&nbsp; A rationale is also helpful, but its extent is up to the
  133. Review Manager. If there are suggestions, or conditions that must be met
  134. before final inclusion, they should be stated.</p>
  135. <h2>Notes for <a name="Review_Manager" id="Review_Manager">Review
  136. Manager</a>s</h2>
  137. <p>Before a library can be scheduled for formal review, an active boost
  138. member not connected with the library submission must volunteer to be the
  139. "Review Manager" for the library.</p>
  140. <p>The Review Manager:</p>
  141. <ul>
  142. <li>Checks the submission to make sure it really is complete enough to
  143. warrant formal review.&nbsp; See the <a href="lib_guide.htm">Boost
  144. Library Requirements and Guidelines</a>.&nbsp; If necessary, work with
  145. the submitter to verify the code compiles and runs correctly on several
  146. compilers and platforms.</li>
  147. <li>Finalizes the schedule with the <a href="#Wizard">Review Wizard</a>
  148. and the submitter .</li>
  149. <li>Posts a notice of the review schedule on the regular <b><a href=
  150. "mailto:boost@lists.boost.org">boost</a></b> mailing list, the
  151. <b><a href="mailto:boost-users@lists.boost.org">boost-users</a></b>
  152. mailing list, and the <b><a href=
  153. "mailto:boost-announce@lists.boost.org">boost-announce</a></b> mailing
  154. list.
  155. <ul>
  156. <li>The notice should include a brief description of the library and
  157. what it does, to let readers know if the library is one they are
  158. interested in reviewing.</li>
  159. <li>If the library is known to fail with certain compilers, please
  160. mention them in the review notice so reviewers with those compilers
  161. won't waste time diagnosing known problems.</li>
  162. </ul>
  163. </li>
  164. <li>Inspects the Boost <a href="../libs/libraries.htm">library
  165. catalogue</a> for libraries which may interact with the new submission.
  166. These potential interactions should be pointed out in the review
  167. announcement, and the author(s) of these libraries should be privately
  168. notified and urged to participate in the review.</li>
  169. <li>Urges people to do reviews if they aren't forthcoming.</li>
  170. <li>Follows review discussions regarding the library, moderating or
  171. answering questions as needed.</li>
  172. <li>Asks the <a href="#Wizard">review wizard</a> for permission
  173. to extend the review schedule if it appears that too few reviews will
  174. be submitted during the review period.</li>
  175. <li>Decides if there is consensus to accept the library, and if there
  176. are any conditions attached.</li>
  177. <li>Decides if there is consensus to accept the library, and if there are
  178. any conditions attached.</li>
  179. <li>Posts a notice of the <a href="#Results">review results</a> on the
  180. regular <b><a href="mailto:boost@lists.boost.org">boost</a></b> mailing
  181. list, the <b><a href=
  182. "mailto:boost-users@lists.boost.org">boost-users</a></b> mailing list,
  183. and the <b><a href=
  184. "mailto:boost-announce@lists.boost.org">boost-announce</a></b> mailing
  185. list.</li>
  186. </ul>
  187. <p>In other words, it is the Review Manager's responsibility to make sure
  188. the review process works smoothly.</p>
  189. <h2>Notes for Library <a name="Submitters" id=
  190. "Submitters">Submitters</a></h2>
  191. <p>See <a href="submission_process.htm">Submission Process</a> for a
  192. description of the steps a library developer goes through to get a library
  193. accepted by Boost.</p>
  194. <p>A proposed library should remain stable during the review period; it
  195. will just confuse and irritate reviewers if there are numerous
  196. changes.&nbsp; It is, however, useful to upload fixes for serious bugs
  197. right away, particularly those which prevent reviewers from fully
  198. evaluating the library.&nbsp; Post a notice of such fixes on the mailing
  199. list.</p>
  200. <p>Library improvements suggested by reviewers should normally be held
  201. until after the completion of review period.&nbsp; If the suggested changes
  202. might affect reviewer's judgments,&nbsp;post a notice of the pending change
  203. on the mailing list.</p>
  204. <h2>Review <a name="Wizard" id="Wizard">Wizard</a></h2>
  205. <p>The Review Wizard coordinates the formal review schedule:</p>
  206. <ul>
  207. <li>Maintains a list of review manager volunteers, in the form of a
  208. queue, so that volunteers who least recently managed reviews become the
  209. prime candidates for upcoming reviews.</li>
  210. <li>When a formal review is requested for a library:</li>
  211. <li style="list-style: none">&nbsp;
  212. <ul>
  213. <li>Assign a review manager and suggests a schedule, after checking
  214. (via private email) availability of the volunteers at the top of
  215. review manager queue.</li>
  216. <li>Finalize the schedule, once the review manager verifies the
  217. library is actually ready for review.</li>
  218. <li>Resolve schedule slips or other issues with review managers and
  219. submitters.</li>
  220. </ul>
  221. </li>
  222. <li>Monitors the general review process, and makes minor adjustments as
  223. needed, or queries the list about possible major adjustments.</li>
  224. </ul>
  225. The role of Boost Review Wizard is currently played by John
  226. Phillips (phillips at mps dot ohio-state dot edu) and Ronald
  227. Garcia (garcia at cs dot indiana dot edu).
  228. <li>Resolves questions from review managers and library submitters, who
  229. sometimes want a third opinion on questions such as "Should we extend the
  230. review period because ...?"</li>
  231. <li>Monitors the general review process, and makes minor adjustments as
  232. needed, or queries the list about possible major adjustments.</li>
  233. </ul>The role of Boost Review Wizard is currently played by <a href=
  234. "mailto:reportbase@yahoo.com">Tom Brinkman</a> and Ronald Garcia (garcia at
  235. cs dot indiana dot edu).
  236. <p>Revised
  237. <!--webbot bot="Timestamp" s-type="EDITED" s-format="%d %B, %Y" startspan -->10 October, 2006<!--webbot bot="Timestamp" endspan i-checksum="38930" --></p>
  238. <p>To qualify for fast track review:</p>
  239. <ul>
  240. <li>The component must be small.</li>
  241. <li>The technique must be already in use in Boost libraries and the new
  242. component provides a common implementation.</li>
  243. <li>A full Boost-conformant implementation is available in the
  244. sandbox.</li>
  245. <li>The Review Wizard determines that the proposal qualifies for fast
  246. track review.</li>
  247. </ul>
  248. <p>Procedure:</p>
  249. <ul>
  250. <li>The Boost Review Wizard posts a review announcement to the main Boost
  251. developer's list. The review period will normally last for 5 days. No two
  252. fast track reviews will run in parallel. Fast track reviews may run
  253. during full reviews, though generally this is to be avoided.</li>
  254. <li>After the review period ends, the submitter will post a review
  255. summary containing proposed changes to the reviewed implementation.</li>
  256. <li>The Review Wizard will accept or reject the proposed library and
  257. proposed changes.</li>
  258. <li>After applying the proposed changes, the component is checked into
  259. CVS like any other library.<br>
  260. &nbsp;</li>
  261. </ul>
  262. <hr>
  263. <p>Revised
  264. <!--webbot bot="Timestamp" s-type="EDITED" s-format="%d %B, %Y" startspan -->15
  265. October, 2003<!--webbot bot="Timestamp" endspan i-checksum="38556" --></p>
  266. <p>&copy; Copyright Beman Dawes 2000</p>
  267. <p>Distributed under the Boost Software License, Version 1.0. (See
  268. accompanying file <a href="../LICENSE_1_0.txt">LICENSE_1_0.txt</a> or copy
  269. at <a href=
  270. "http://www.boost.org/LICENSE_1_0.txt">http://www.boost.org/LICENSE_1_0.txt</a>)</p>
  271. </body>
  272. </html>
粤ICP备19079148号