{"id":11170,"date":"2024-05-20T23:35:52","date_gmt":"2024-05-20T21:35:52","guid":{"rendered":"https:\/\/www.auto-ui.org\/25\/?page_id=11170"},"modified":"2025-06-12T04:33:35","modified_gmt":"2025-06-12T02:33:35","slug":"instructionsandtips","status":"publish","type":"page","link":"https:\/\/www.auto-ui.org\/25\/authors\/reviewing\/instructionsandtips\/","title":{"rendered":"Instructions and Tips"},"content":{"rendered":"<h1>\n<div class=\"page\" title=\"Page 1\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<h1>Reviewer Instructions and Tips<\/h1>\n<\/div>\n<\/div>\n<\/div>\n<\/h1>\n<hr>\n<div>\n<p>This website is meant as a quick overview of information related to the review process of AutomotiveUI, especially the papers track. This page is a work-in-progress, that we occasionally update in an attempt to be as transparent as possible about criteria and context.<\/p>\n<p>We discuss these topics:<\/p>\n<\/div>\n<div>\n<h3>Important dates<\/h3>\n<div>\n<div class=\"message_ccca67 cozyMessage__9f4fd wrapper_a62503 cozy_f5c119 zalgo__39311\" role=\"article\" data-list-item-id=\"chat-messages___chat-messages-1200512366635397141-1242376796914192405\" aria-setsize=\"-1\" aria-roledescription=\"Message\" aria-labelledby=\"message-username-1242376277613084672 uid_1 message-content-1242376796914192405 uid_2 message-timestamp-1242376796914192405\" tabindex=\"-1\">\n<div>\n<ul>\n<li id=\"message-content-1242376796914192405\">Deadline for Reviews (2AC &amp; external reviewers): <strong>May 22, 2025<\/strong><\/li>\n<li>Consolidation discussion (1AC, 2AC &amp; external reviewers): <strong>May 22 &#8211; May 28, 2025<\/strong><\/li>\n<li>Deadline for Meta-Reviews (1AC): <strong>May 29, 2025<\/strong><\/li>\n<\/ul>\n<p>All deadlines are AoE (anywhere on earth) on the date shown.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<ul>\n<li>\n<h3>Terminology<\/h3>\n<div>\n<p>The following terms are used:<\/p>\n<ul>\n<li><strong>(External) Reviewer:<\/strong> an expert who gives an independent evaluation of a submitted paper<\/li>\n<li><strong>TPC: Technical Program Chairs. <\/strong>People that oversee the entire review process in a specific year of the conference. They invite ACs, and have the final decision over which papers get accepted or rejected for the conference, based on reviews and AC scores across the entire set of papers.<\/li>\n<li><strong>GC: General Chairs. <\/strong>People that oversee the entire conference. They invite all the co-chairs, such as the technical program chairs. Other co-chairs are for example the coordinators of the work-in-progress track, or of the video track.<\/li>\n<li><span data-olk-copy-source=\"MessageBody\"><strong>Subcommittee Chair:<\/strong> Experienced community member who oversees and coordinate a thematically clustered collection of submissions during the reviewing process. The subcommittee chairs assist and provide guidance to the ACs, and represent their assigned submissions during the program meeting with the TPCs.<\/span><\/li>\n<li><strong>AC: Associate Chair. <\/strong>Sometimes referred to as meta-reviewer. A more experienced researcher from the field that oversees the review process of a specific set of papers (typically 2 to 5 papers), including inviting external reviewers. We distinguish 1AC and 2AC. Each AC typically serves in both roles on different papers.<\/li>\n<li><strong>1AC:<\/strong> An AC that acts as the primary coordinator of the review process of a submission. The TPC assign a 1AC to each paper. The 1AC invites at least 1 external reviewer to assess the paper, and they summarize the reviews. The TPC use the summary of the 1AC, and the underlying reviews, to decide whether to accept or reject a paper for presentation at the conference and associated publication.<\/li>\n<li><strong>2AC<\/strong>: Invites one external reviewer to review the paper and writes one review themselves (double-blind).<\/li>\n<li><strong>Program committee<\/strong>: the set of ACs of a specific conference year.<\/li>\n<li><strong>Discussion phase:<\/strong> phase during the review process after each reviewer has written an independent review. At this stage, reviewers can see each others\u2019 reviews and scores. They can then discuss it using an internal discussion forum to overcome large differences. This helps the 1AC in reaching a consensus impression on each paper. Although the content of the discussion forum is not publicly visible, the 1AC summarizes the outcome in their meta-review.<\/li>\n<li><strong>Reviewed process<\/strong>: a process in which submissions are reviewed by independent experts. For example, for AutomotiveUI the paper track is reviewed.<\/li>\n<li><strong>Juried:<\/strong> a process in which submissions are assessed by a jury to decide who to invite to an opportunity and where other factors (e.g., geographic balance, gender balance) might also form part of the selection criteria. An example of a juried track is the Doctoral Colloquium.<\/li>\n<li><strong>PCS<\/strong>: Precision conference system, the website used for submitting and reviewing work. See: <a href=\"https:\/\/new.precisionconference.com\/user\/login\">https:\/\/new.precisionconference.com\/user\/login<\/a><\/li>\n<li><strong>ACM: Association for Computing Machinery <\/strong>&#8211; parent organization of SIGCHI. See <a href=\"https:\/\/www.acm.org\/\">https:\/\/www.acm.org\/<\/a><\/li>\n<li><strong>SIGCHI:<\/strong> Special interest group on Computer-Human Interaction of ACM. SIGCHI organizes many conferences, of which AutomotiveUI is one. See <a href=\"https:\/\/sigchi.org\/\">https:\/\/sigchi.org\/<\/a><\/li>\n<\/ul>\n<\/div>\n<\/li>\n<li>\n<h3>Before you begin as a reviewer<\/h3>\n<div>\n<p>You can volunteer to become a reviewer for AutomotiveUI 2024 via the precision conference system <a href=\"https:\/\/new.precisionconference.com\/review_volunteering\">https:\/\/new.precisionconference.com\/review_volunteering<\/a><\/p>\n<p>When you volunteer, we ask you to update your profile with the following information via various submenus here:<\/p>\n<ul>\n<li><strong>Add example paper<\/strong>s that you published in the past on this subpage: <a href=\"https:\/\/new.precisionconference.com\/sample_pubs\">https:\/\/new.precisionconference.com\/sample_pubs<\/a><\/li>\n<li><strong>Add keywords<\/strong> relevant to your style of work. Note that typically each person has limited expertise, so do not write that you are an \u201cexpert\u201d in all domains, but be selective. You can fill out information on this page: <a href=\"https:\/\/new.precisionconference.com\/expertise\">https:\/\/new.precisionconference.com\/expertise<\/a> under \u201csociety\u201d select \u201cSIGCHI\u201d and under conference\/journal select \u201cAutomotiveUI of the year that you are reviewing (e.g., \u201cAutomotiveUI 2024\u201d)<\/li>\n<li><strong>Add your website <\/strong>and other information in your profile here. Ideally, a website that gives an overview of your research experience (e.g., including overview of paper, past projects)<\/li>\n<\/ul>\n<p>ACs use this information to select the best reviewers that match the work. Keywords and example papers are also used by PCS to semi-automatically suggest suitable reviewers. Update this to have the best matches to your expertise.<\/p>\n<\/div>\n<\/li>\n<li>\n<h3>When you get invited to review a paper<\/h3>\n<div>\n<p>You will be invited by ACs via e-mail (automated message from PCS) to review a paper.<\/p>\n<ul>\n<li>Please respond as soon as possible to the invite, as we are on a strict time limit<\/li>\n<li>Decide whether a paper is indeed a match to your expertise. If it is not, let the AC know. If you have a suggestion for someone else that we might ask, we always welcome that information, but you are not required to.<\/li>\n<li>If you suspect you might have a conflict of interest, let the coordinating AC or the person who invited you know.<\/li>\n<li>Mark your calendar to allocate sufficient time to review the paper.<\/li>\n<\/ul>\n<\/div>\n<\/li>\n<li>\n<h3>Process<\/h3>\n<div>\n<p>The general reviewing process of the Papers track is explained in the call of the papers track.<\/p>\n<p>Check the section \u201creview process\u201d here: <a href=\"https:\/\/www.auto-ui.org\/25\/authors\/papers\/\">https:\/\/www.auto-ui.org\/25\/authors\/papers\/<\/a><\/p>\n<\/div>\n<\/li>\n<li>\n<h3>Criteria<\/h3>\n<div>\n<p>AutomotiveUI strives to accept the best scientific work that is relevant for the AutomotiveUI community. As a reviewer you give an assessment of the paper to inform the <em>Associate Chair<\/em> (AC), knowing that authors will also read your review. The AC uses your review and that of other reviewers to recommend acceptance of rejection of the paper to the Technical Program Chairs, who take the final decision.<\/p>\n<p>\u00a0<\/p>\n<p>Reviewers are asked to consider for each paper:<\/p>\n<ul>\n<li><strong>Contribution to the field:<\/strong> Note that AutomotiveUI has a multi-disciplinary audience and that different methods are used. Different methods have different standards and expectations. Authors indicate what method \/ area their intended contribution is in. Judge the paper by the standards that hold for that specific method.<\/li>\n<li><strong>Innovation<\/strong> Does this submission present something new or something that has been done before but in an improved manner? Does it extend what we know?<br \/>Each paper typically brings something new to the table. This does not mean that it needs to be \u201cradically different\u201d. Rather, the paper should build on preceding work and demonstrate what the added value is relative to existing work. As we have a multi-disciplinary community, innovation can take many forms.<\/li>\n<li><strong>Quality of thought and writing<\/strong> The write-up should be scientifically sound and valid, and understandable. This can include aspects such as:\n<ul>\n<li>Are the questions to be examined clearly stated?<\/li>\n<li>Does the submission link to previous research to the questions examined? I.e., does it appropriately cite prior work, including relevant Auto-UI research?<\/li>\n<li>If the research was experimental, was it rigorously and carefully done? Are there enough details so that someone else can repeat the evaluation (for instance use SAE J2944 definitions)?<\/li>\n<li>Is the paper well written (e.g., no grammatical errors, references are formatted properly)? If writing quality is a concern, consider consulting a professional editor. (See <a href=\"http:\/\/acm.internationalscienceediting.com\/\">internationalscienceediting.com<\/a>)<\/li>\n<li>Paper length: is the contribution of the paper in accordance with its length?<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>\u00a0<\/p>\n<p>You express your judgment in three ways:<\/p>\n<p>1. Using a rating of the quality of the paper with options:<\/p>\n<ul>\n<li>Definite accept: I would argue strongly for accepting this paper.<\/li>\n<li>Probably accept: I would argue for accepting this paper.<\/li>\n<li>Borderline: Overall I would neither argue for accepting nor for rejecting this paper.<\/li>\n<li>Probably reject: I would argue for rejecting this paper.<\/li>\n<li>Definite reject: I would argue strongly for rejecting this paper.<\/li>\n<\/ul>\n<p>2. Using a rating of your expertise on the domain and\/or method at hand. This can be used to weigh your other assessments:<\/p>\n<ul>\n<li>Expert<\/li>\n<li>Knowledgeable<\/li>\n<li>Passing Knowledge<\/li>\n<li>No Knowledge<\/li>\n<\/ul>\n<p>3. Through a qualitative review of the paper that summarizes its <em>strengths<\/em> and <em>weaknesses, <\/em>and explains your numerical score.<\/p>\n<p>\u00a0<\/p>\n<p>When reviewing, you can consider ACM SIGCHI\u2019s criteria that reviews should be (a) high quality and (b) fair.<\/p>\n<p><strong>High quality <\/strong>implies that you systematically and clearly motivate your assessment. Even if you think a paper is great, you should motivate why, so the AC and TPC also understand this (not all might be familiar with this specific method or topic).\u00a0<\/p>\n<p>If you think a paper is weak, you should explain why. Keep in mind that authors are reading this, so your feedback can help them improve this line of work in the future. Especially when the first author is a (PhD) student, your constructive feedback can help them improve this line of work. Don\u2019t just say <em>that<\/em> something is not good enough, but explain <em>why<\/em> and use <em>sound<\/em> argumentation.<\/p>\n<p><strong>Fair<\/strong> can be understood in multiple ways:<\/p>\n<ul>\n<li>Make sure you are in a position to judge the paper fairly. For example, you should have sufficient expertise on the topic\/method, and you should take sufficient time to read and assess it carefully.<\/li>\n<li>Be constructive in your criticism. Even papers that you think should not be accepted have positives. Make sure to also mention those.<\/li>\n<li>Judge the paper \u201cas is\u201d, not what it could also be. As AutomotiveUI has contributions from different disciplines, different research methods are applied. Judge it mostly based on the criteria that are applicable to that method, not by the criteria of a different method (for example: don\u2019t judge a qualitative user study by the criteria of a quantitative user study)<\/li>\n<\/ul>\n<\/div>\n<\/li>\n<li>\n<h3>Reviewer Tips<\/h3>\n<div>\n<ul>\n<li>If anything is unclear, or if you are in doubt: reach out to the 1AC or the AC that invited you as a reviewer<\/li>\n<li>If an AC is not responsive (and you have given sufficient time), reach out to the other AC, or to the technical program chair via <span title=\"\" class=\"pep-email\">papers(Replace this parenthesis with the @ sign)auto-ui.org<\/span><\/li>\n<li>Strive for a review that is of high quality and fair.<\/li>\n<li>Always motivate your judgement<\/li>\n<li>Always mention at least one positive about the work<\/li>\n<li>In your review explicitly separate \u201cmajor\u201d issues\/limitations from \u201cminor\u201d issues (e.g., typos). Major issues are more structural \/ bigger limitations that you identified, and that would often need to be addressed by an author before the paper can be accepted. Note that AutomotiveUI does not have a rebuttal process where authors respond to reviews.<\/li>\n<li>Consider numbering your major issues, so the AC can easily refer to specific points from your review<\/li>\n<li>Acknowledge that sometimes the write-up of the work might not be perfect, but the actual work might be sufficient. The authors then need to express their message clearer.<\/li>\n<li>Once the meta-review is written, check whether the AC indeed understood what you meant. If they misinterpreted your review, clarify it with them. Note that ACs typically do not list all points from all reviewers. You can also use this time to calibrate your own reviewing skills: did you spot the same strengths and weaknesses as other reviewers?<\/li>\n<\/ul>\n<\/div>\n<\/li>\n<li>\n<h3>Other sources<\/h3>\n<div>\n<p>AutomotiveUI is a conference organized by ACM SIGCHI. Some broader policies and tips can therefore be found on other sites. Note that not everything applies to AutomotiveUI:<\/p>\n<ul>\n<li><a href=\"https:\/\/sigchi.org\/about\/policies\/conference-policies\/submission-and-review\/\">ACM notes on submissions and review<\/a><\/li>\n<li><a href=\"https:\/\/chi2025.acm.org\/guide-to-reviewing-papers\/\">Notes from CHI 2025 on reviewing papers<\/a><\/li>\n<li><a href=\"https:\/\/chi2025.acm.org\/guide-to-a-successful-submission\/\">Notes from CHI 2025 on a successful submission<\/a><\/li>\n<\/ul>\n<\/div>\n<\/li>\n<\/ul>\n<p><!--more--><br \/>\n<!-- {\"type\":\"layout\",\"children\":[{\"name\":\"General review policy\",\"type\":\"section\",\"props\":{\"id\":\"grp\",\"image_position\":\"center-center\",\"style\":\"default\",\"title_breakpoint\":\"xl\",\"title_position\":\"top-left\",\"title_rotation\":\"left\",\"vertical_align\":\"\",\"width\":\"small\"},\"children\":[{\"type\":\"row\",\"children\":[{\"type\":\"column\",\"props\":{\"image_position\":\"center-center\",\"position_sticky_breakpoint\":\"m\",\"width_medium\":\"1-1\"},\"children\":[{\"type\":\"headline\",\"props\":{\"content\":\"\n\n<div class=\\\"page\\\" title=\\\"Page 1\\\">\\n\n\n<div class=\\\"layoutArea\\\">\\n\n\n<div class=\\\"column\\\">\\n\n\n<h1>Reviewer Instructions and Tips<\\\/h1>\\n<\\\/div>\\n<\\\/div>\\n<\\\/div>\",\"title_element\":\"h1\",\"title_style\":\"heading-small\"}},{\"type\":\"divider\",\"props\":{\"divider_element\":\"hr\",\"divider_style\":\"small\"}}]}]},{\"type\":\"row\",\"props\":{\"layout\":\"1-2,1-2\"},\"children\":[{\"type\":\"column\",\"props\":{\"image_position\":\"center-center\",\"position_sticky_breakpoint\":\"m\",\"width_medium\":\"1-2\"},\"children\":[{\"type\":\"text\",\"props\":{\"column_breakpoint\":\"m\",\"content\":\"\n\n<p>This website is meant as a quick overview of information related to the review process of AutomotiveUI, especially the papers track. This page is a work-in-progress, that we occasionally update in an attempt to be as transparent as possible about criteria and context.<\\\/p>\\n\n\n<p>We discuss these topics:<\\\/p>\",\"margin\":\"default\"}}]},{\"type\":\"column\",\"props\":{\"image_position\":\"center-center\",\"position_sticky_breakpoint\":\"m\",\"width_medium\":\"1-2\"},\"children\":[{\"type\":\"panel\",\"props\":{\"content\":\"\n\n<div class=\\\"message_ccca67 cozyMessage__9f4fd wrapper_a62503 cozy_f5c119 zalgo__39311\\\" role=\\\"article\\\" data-list-item-id=\\\"chat-messages___chat-messages-1200512366635397141-1242376796914192405\\\" aria-setsize=\\\"-1\\\" aria-roledescription=\\\"Message\\\" aria-labelledby=\\\"message-username-1242376277613084672 uid_1 message-content-1242376796914192405 uid_2 message-timestamp-1242376796914192405\\\" tabindex=\\\"-1\\\">\\n\n\n<div>\\n\n\n<ul>\\n\n\n<li id=\\\"message-content-1242376796914192405\\\">Deadline for Reviews (2AC &amp; external reviewers): <strong>May 22, 2025<\\\/strong><\\\/li>\\n\n\n<li>Consolidation discussion (1AC, 2AC &amp; external reviewers): <strong>May 22 - May 28, 2025<\\\/strong><\\\/li>\\n\n\n<li>Deadline for Meta-Reviews (1AC): <strong>May 29, 2025<\\\/strong><\\\/li>\\n<\\\/ul>\\n\n\n<p>All deadlines are AoE (anywhere on earth) on the date shown.<\\\/p>\\n<\\\/div>\\n<\\\/div>\",\"content_column_breakpoint\":\"m\",\"icon_width\":80,\"image_align\":\"top\",\"image_grid_breakpoint\":\"m\",\"image_grid_width\":\"1-2\",\"image_svg_color\":\"emphasis\",\"link_style\":\"default\",\"link_text\":\"Read more\",\"margin\":\"default\",\"maxwidth\":\"xlarge\",\"meta_align\":\"below-title\",\"meta_element\":\"div\",\"meta_style\":\"text-meta\",\"panel_padding\":\"default\",\"panel_style\":\"card-primary\",\"title\":\"Important dates\",\"title_align\":\"top\",\"title_element\":\"h3\",\"title_grid_breakpoint\":\"m\",\"title_grid_width\":\"1-2\",\"title_hover_style\":\"reset\"}}]}]}]},{\"type\":\"section\",\"props\":{\"image_position\":\"center-center\",\"padding_remove_top\":true,\"style\":\"default\",\"title_breakpoint\":\"xl\",\"title_position\":\"top-left\",\"title_rotation\":\"left\",\"vertical_align\":\"\",\"width\":\"small\"},\"children\":[{\"type\":\"row\",\"children\":[{\"type\":\"column\",\"props\":{\"image_position\":\"center-center\",\"position_sticky_breakpoint\":\"m\",\"width_medium\":\"1-1\"},\"children\":[{\"type\":\"accordion\",\"props\":{\"collapsible\":true,\"content_column_breakpoint\":\"m\",\"image_align\":\"top\",\"image_grid_breakpoint\":\"m\",\"image_grid_width\":\"1-2\",\"image_svg_color\":\"emphasis\",\"link_style\":\"default\",\"link_text\":\"Read more\",\"show_image\":true,\"show_link\":true,\"title_element\":\"h3\"},\"children\":[{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>The following terms are used:<\\\/p>\\n\n\n<ul>\\n\n\n<li><strong>(External) Reviewer:<\\\/strong> an expert who gives an independent evaluation of a submitted paper<\\\/li>\\n\n\n<li><strong>TPC: Technical Program Chairs. <\\\/strong>People that oversee the entire review process in a specific year of the conference. They invite ACs, and have the final decision over which papers get accepted or rejected for the conference, based on reviews and AC scores across the entire set of papers.<\\\/li>\\n\n\n<li><strong>GC: General Chairs. <\\\/strong>People that oversee the entire conference. They invite all the co-chairs, such as the technical program chairs. Other co-chairs are for example the coordinators of the work-in-progress track, or of the video track.<\\\/li>\\n\n\n<li><span data-olk-copy-source=\\\"MessageBody\\\"><strong>Subcommittee Chair:<\\\/strong> Experienced community member who oversees and coordinate a thematically clustered collection of submissions during the reviewing process. The subcommittee chairs assist and provide guidance to the ACs, and represent their assigned submissions during the program meeting with the TPCs.<\\\/span><\\\/li>\\n\n\n<li><strong>AC: Associate Chair. <\\\/strong>Sometimes referred to as meta-reviewer. A more experienced researcher from the field that oversees the review process of a specific set of papers (typically 2 to 5 papers), including inviting external reviewers. We distinguish 1AC and 2AC. Each AC typically serves in both roles on different papers.<\\\/li>\\n\n\n<li><strong>1AC:<\\\/strong> An AC that acts as the primary coordinator of the review process of a submission. The TPC assign a 1AC to each paper. The 1AC invites at least 1 external reviewer to assess the paper, and they summarize the reviews. The TPC use the summary of the 1AC, and the underlying reviews, to decide whether to accept or reject a paper for presentation at the conference and associated publication.<\\\/li>\\n\n\n<li><strong>2AC<\\\/strong>: Invites one external reviewer to review the paper and writes one review themselves (double-blind).<\\\/li>\\n\n\n<li><strong>Program committee<\\\/strong>: the set of ACs of a specific conference year.<\\\/li>\\n\n\n<li><strong>Discussion phase:<\\\/strong> phase during the review process after each reviewer has written an independent review. At this stage, reviewers can see each others\\u2019 reviews and scores. They can then discuss it using an internal discussion forum to overcome large differences. This helps the 1AC in reaching a consensus impression on each paper. Although the content of the discussion forum is not publicly visible, the 1AC summarizes the outcome in their meta-review.<\\\/li>\\n\n\n<li><strong>Reviewed process<\\\/strong>: a process in which submissions are reviewed by independent experts. For example, for AutomotiveUI the paper track is reviewed.<\\\/li>\\n\n\n<li><strong>Juried:<\\\/strong> a process in which submissions are assessed by a jury to decide who to invite to an opportunity and where other factors (e.g., geographic balance, gender balance) might also form part of the selection criteria. An example of a juried track is the Doctoral Colloquium.<\\\/li>\\n\n\n<li><strong>PCS<\\\/strong>: Precision conference system, the website used for submitting and reviewing work. See: <a href=\\\"https:\\\/\\\/new.precisionconference.com\\\/user\\\/login\\\">https:\\\/\\\/new.precisionconference.com\\\/user\\\/login<\\\/a><\\\/li>\\n\n\n<li><strong>ACM: Association for Computing Machinery <\\\/strong>- parent organization of SIGCHI. See <a href=\\\"https:\\\/\\\/www.acm.org\\\/\\\">https:\\\/\\\/www.acm.org\\\/<\\\/a><\\\/li>\\n\n\n<li><strong>SIGCHI:<\\\/strong> Special interest group on Computer-Human Interaction of ACM. SIGCHI organizes many conferences, of which AutomotiveUI is one. See <a href=\\\"https:\\\/\\\/sigchi.org\\\/\\\">https:\\\/\\\/sigchi.org\\\/<\\\/a><\\\/li>\\n<\\\/ul>\",\"title\":\"Terminology\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>You can volunteer to become a reviewer for AutomotiveUI 2024 via the precision conference system <a href=\\\"https:\\\/\\\/new.precisionconference.com\\\/review_volunteering\\\">https:\\\/\\\/new.precisionconference.com\\\/review_volunteering<\\\/a><\\\/p>\\n\n\n<p>When you volunteer, we ask you to update your profile with the following information via various submenus here:<\\\/p>\\n\n\n<ul>\\n\n\n<li><strong>Add example paper<\\\/strong>s that you published in the past on this subpage: <a href=\\\"https:\\\/\\\/new.precisionconference.com\\\/sample_pubs\\\">https:\\\/\\\/new.precisionconference.com\\\/sample_pubs<\\\/a><\\\/li>\\n\n\n<li><strong>Add keywords<\\\/strong> relevant to your style of work. Note that typically each person has limited expertise, so do not write that you are an \\u201cexpert\\u201d in all domains, but be selective. You can fill out information on this page: <a href=\\\"https:\\\/\\\/new.precisionconference.com\\\/expertise\\\">https:\\\/\\\/new.precisionconference.com\\\/expertise<\\\/a> under \\u201csociety\\u201d select \\u201cSIGCHI\\u201d and under conference\\\/journal select \\u201cAutomotiveUI of the year that you are reviewing (e.g., \\u201cAutomotiveUI 2024\\u201d)<\\\/li>\\n\n\n<li><strong>Add your website <\\\/strong>and other information in your profile here. Ideally, a website that gives an overview of your research experience (e.g., including overview of paper, past projects)<\\\/li>\\n<\\\/ul>\\n\n\n<p>ACs use this information to select the best reviewers that match the work. Keywords and example papers are also used by PCS to semi-automatically suggest suitable reviewers. Update this to have the best matches to your expertise.<\\\/p>\",\"title\":\"Before you begin as a reviewer\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>You will be invited by ACs via e-mail (automated message from PCS) to review a paper.<\\\/p>\\n\n\n<ul>\\n\n\n<li>Please respond as soon as possible to the invite, as we are on a strict time limit<\\\/li>\\n\n\n<li>Decide whether a paper is indeed a match to your expertise. If it is not, let the AC know. If you have a suggestion for someone else that we might ask, we always welcome that information, but you are not required to.<\\\/li>\\n\n\n<li>If you suspect you might have a conflict of interest, let the coordinating AC or the person who invited you know.<\\\/li>\\n\n\n<li>Mark your calendar to allocate sufficient time to review the paper.<\\\/li>\\n<\\\/ul>\",\"title\":\"When you get invited to review a paper\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>The general reviewing process of the Papers track is explained in the call of the papers track.<\\\/p>\\n\n\n<p>Check the section \\u201creview process\\u201d here: <a href=\\\"https:\\\/\\\/www.auto-ui.org\\\/25\\\/authors\\\/papers\\\/\\\">https:\\\/\\\/www.auto-ui.org\\\/25\\\/authors\\\/papers\\\/<\\\/a><\\\/p>\",\"title\":\"Process\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>AutomotiveUI strives to accept the best scientific work that is relevant for the AutomotiveUI community. As a reviewer you give an assessment of the paper to inform the <em>Associate Chair<\\\/em> (AC), knowing that authors will also read your review. The AC uses your review and that of other reviewers to recommend acceptance of rejection of the paper to the Technical Program Chairs, who take the final decision.<\\\/p>\\n\n\n<p>\\u00a0<\\\/p>\\n\n\n<p>Reviewers are asked to consider for each paper:<\\\/p>\\n\n\n<ul>\\n\n\n<li><strong>Contribution to the field:<\\\/strong> Note that AutomotiveUI has a multi-disciplinary audience and that different methods are used. Different methods have different standards and expectations. Authors indicate what method \\\/ area their intended contribution is in. Judge the paper by the standards that hold for that specific method.<\\\/li>\\n\n\n<li><strong>Innovation<\\\/strong> Does this submission present something new or something that has been done before but in an improved manner? Does it extend what we know?<br \\\/>Each paper typically brings something new to the table. This does not mean that it needs to be \\u201cradically different\\u201d. Rather, the paper should build on preceding work and demonstrate what the added value is relative to existing work. As we have a multi-disciplinary community, innovation can take many forms.<\\\/li>\\n\n\n<li><strong>Quality of thought and writing<\\\/strong> The write-up should be scientifically sound and valid, and understandable. This can include aspects such as:\\n\n\n<ul>\\n\n\n<li>Are the questions to be examined clearly stated?<\\\/li>\\n\n\n<li>Does the submission link to previous research to the questions examined? I.e., does it appropriately cite prior work, including relevant Auto-UI research?<\\\/li>\\n\n\n<li>If the research was experimental, was it rigorously and carefully done? Are there enough details so that someone else can repeat the evaluation (for instance use SAE J2944 definitions)?<\\\/li>\\n\n\n<li>Is the paper well written (e.g., no grammatical errors, references are formatted properly)? If writing quality is a concern, consider consulting a professional editor. (See <a href=\\\"http:\\\/\\\/acm.internationalscienceediting.com\\\/\\\">internationalscienceediting.com<\\\/a>)<\\\/li>\\n\n\n<li>Paper length: is the contribution of the paper in accordance with its length?<\\\/li>\\n<\\\/ul>\\n<\\\/li>\\n<\\\/ul>\\n\n\n<p>\\u00a0<\\\/p>\\n\n\n<p>You express your judgment in three ways:<\\\/p>\\n\n\n<p>1. Using a rating of the quality of the paper with options:<\\\/p>\\n\n\n<ul>\\n\n\n<li>Definite accept: I would argue strongly for accepting this paper.<\\\/li>\\n\n\n<li>Probably accept: I would argue for accepting this paper.<\\\/li>\\n\n\n<li>Borderline: Overall I would neither argue for accepting nor for rejecting this paper.<\\\/li>\\n\n\n<li>Probably reject: I would argue for rejecting this paper.<\\\/li>\\n\n\n<li>Definite reject: I would argue strongly for rejecting this paper.<\\\/li>\\n<\\\/ul>\\n\n\n<p>2. Using a rating of your expertise on the domain and\\\/or method at hand. This can be used to weigh your other assessments:<\\\/p>\\n\n\n<ul>\\n\n\n<li>Expert<\\\/li>\\n\n\n<li>Knowledgeable<\\\/li>\\n\n\n<li>Passing Knowledge<\\\/li>\\n\n\n<li>No Knowledge<\\\/li>\\n<\\\/ul>\\n\n\n<p>3. Through a qualitative review of the paper that summarizes its <em>strengths<\\\/em> and <em>weaknesses, <\\\/em>and explains your numerical score.<\\\/p>\\n\n\n<p>\\u00a0<\\\/p>\\n\n\n<p>When reviewing, you can consider ACM SIGCHI\\u2019s criteria that reviews should be (a) high quality and (b) fair.<\\\/p>\\n\n\n<p><strong>High quality <\\\/strong>implies that you systematically and clearly motivate your assessment. Even if you think a paper is great, you should motivate why, so the AC and TPC also understand this (not all might be familiar with this specific method or topic).\\u00a0<\\\/p>\\n\n\n<p>If you think a paper is weak, you should explain why. Keep in mind that authors are reading this, so your feedback can help them improve this line of work in the future. Especially when the first author is a (PhD) student, your constructive feedback can help them improve this line of work. Don\\u2019t just say <em>that<\\\/em> something is not good enough, but explain <em>why<\\\/em> and use <em>sound<\\\/em> argumentation.<\\\/p>\\n\n\n<p><strong>Fair<\\\/strong> can be understood in multiple ways:<\\\/p>\\n\n\n<ul>\\n\n\n<li>Make sure you are in a position to judge the paper fairly. For example, you should have sufficient expertise on the topic\\\/method, and you should take sufficient time to read and assess it carefully.<\\\/li>\\n\n\n<li>Be constructive in your criticism. Even papers that you think should not be accepted have positives. Make sure to also mention those.<\\\/li>\\n\n\n<li>Judge the paper \\u201cas is\\u201d, not what it could also be. As AutomotiveUI has contributions from different disciplines, different research methods are applied. Judge it mostly based on the criteria that are applicable to that method, not by the criteria of a different method (for example: don\\u2019t judge a qualitative user study by the criteria of a quantitative user study)<\\\/li>\\n<\\\/ul>\",\"title\":\"Criteria\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<ul>\\n\n\n<li>If anything is unclear, or if you are in doubt: reach out to the 1AC or the AC that invited you as a reviewer<\\\/li>\\n\n\n<li>If an AC is not responsive (and you have given sufficient time), reach out to the other AC, or to the technical program chair via <a href=\\\"mailto:<span title=\"\" class=\"pep-email\">papers(Replace this parenthesis with the @ sign)auto-ui.org<\/span>\\\"><span title=\"\" class=\"pep-email\">papers(Replace this parenthesis with the @ sign)auto-ui.org<\/span><\\\/a><\\\/li>\\n\n\n<li>Strive for a review that is of high quality and fair.<\\\/li>\\n\n\n<li>Always motivate your judgement<\\\/li>\\n\n\n<li>Always mention at least one positive about the work<\\\/li>\\n\n\n<li>In your review explicitly separate \\u201cmajor\\u201d issues\\\/limitations from \\u201cminor\\u201d issues (e.g., typos). Major issues are more structural \\\/ bigger limitations that you identified, and that would often need to be addressed by an author before the paper can be accepted. Note that AutomotiveUI does not have a rebuttal process where authors respond to reviews.<\\\/li>\\n\n\n<li>Consider numbering your major issues, so the AC can easily refer to specific points from your review<\\\/li>\\n\n\n<li>Acknowledge that sometimes the write-up of the work might not be perfect, but the actual work might be sufficient. The authors then need to express their message clearer.<\\\/li>\\n\n\n<li>Once the meta-review is written, check whether the AC indeed understood what you meant. If they misinterpreted your review, clarify it with them. Note that ACs typically do not list all points from all reviewers. You can also use this time to calibrate your own reviewing skills: did you spot the same strengths and weaknesses as other reviewers?<\\\/li>\\n<\\\/ul>\",\"title\":\"Reviewer Tips\"}},{\"type\":\"accordion_item\",\"props\":{\"content\":\"\n\n<p>AutomotiveUI is a conference organized by ACM SIGCHI. Some broader policies and tips can therefore be found on other sites. Note that not everything applies to AutomotiveUI:<\\\/p>\\n\n\n<ul>\\n\n\n<li><a href=\\\"https:\\\/\\\/sigchi.org\\\/about\\\/policies\\\/conference-policies\\\/submission-and-review\\\/\\\">ACM notes on submissions and review<\\\/a><\\\/li>\\n\n\n<li><a href=\\\"https:\\\/\\\/chi2025.acm.org\\\/guide-to-reviewing-papers\\\/\\\">Notes from CHI 2025 on reviewing papers<\\\/a><\\\/li>\\n\n\n<li><a href=\\\"https:\\\/\\\/chi2025.acm.org\\\/guide-to-a-successful-submission\\\/\\\">Notes from CHI 2025 on a successful submission<\\\/a><\\\/li>\\n<\\\/ul>\",\"title\":\"Other sources\"}}]}]}]}]}],\"version\":\"4.4.20\"} --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reviewer Instructions and Tips This website is meant as a quick overview of information related to the review process of AutomotiveUI, especially the papers track. This page is a work-in-progress, that we occasionally update in an attempt to be as transparent as possible about criteria and context. We discuss these topics: Important dates Deadline for [&hellip;]<\/p>\n","protected":false},"author":48,"featured_media":0,"parent":11164,"menu_order":70,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-11170","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/pages\/11170","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/users\/48"}],"replies":[{"embeddable":true,"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/comments?post=11170"}],"version-history":[{"count":12,"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/pages\/11170\/revisions"}],"predecessor-version":[{"id":12445,"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/pages\/11170\/revisions\/12445"}],"up":[{"embeddable":true,"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/pages\/11164"}],"wp:attachment":[{"href":"https:\/\/www.auto-ui.org\/25\/wp-json\/wp\/v2\/media?parent=11170"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}