由詹姆斯•巴赫测试挑战

Attention ShiftSync community! We are excited to announce a brand new testing challenge prepared exclusively for you by the renowned expert, James Bach. The purpose of this challenge is to provide you with a way to showcase your analytical testing skills for other people to review and evaluate. You will get a winner badge and a certificate of achievement<\/strong>.\u00a0<\/p>

Voting goes by likes. Like answers, which in your opinion provide the best solution to the challenge. The replies with the greatest number of likes will get winner badges.<\/p>

Voting will be closed on 24.07.2023<\/strong>. However, even after the deadline, you may submit your solution in the comments and receive points.<\/p>

\u00a0<\/p>

\t\t\t Chapter<\/p>\t\t\t<\/td>\t\t\t	\t\t\t Here is a parking cost calculator for an airport: https:\/\/developsense.com\/parkcalc\/index.php<\/span> (This was copied from a real airport website, some years ago.) \t\t\tThere is a rumor that, because of poor input validation, you can make this calculator show huge parking costs (into the billions of dollars). Try to reproduce that. What is the highest amount you can make it quote you for parking?<\/p>\t\t\t<\/td>\t\t<\/tr>
\t\t\t Protocol<\/p>\t\t\t<\/td>\t\t\t	\t\t\t This is a hard problem meant to challenge you. There is no fixed time limit for solving it.<\/li>\t\t\t\t Use any resource you like to solve this problem. Tackling this with a team of people tends to work well.<\/li>\t\t\t<\/ul><\/td>\t\t<\/tr>
\t\t\t Deliverable<\/p>\t\t\t<\/td>\t\t\t	\t\t\t Please explain your process in the comment section.<\/li>\t\t\t\t Take screenshots of your most interesting and extreme results and attach them to your comment.<\/li>\t\t\t<\/ul><\/td>\t\t<\/tr><\/tbody><\/table> \u00a0<\/p> About James Bach: \u00a0<\/p> James Bach@satisfice<\/user-mention>\u00a0 is a highly influential figure in software testing, renowned for his pioneering work on exploratory testing. His book, \"Lessons Learned in Software Testing,\" co-authored with Cem Kaner and Bret Pettichord, is a go-to resource for testers worldwide. Bach emphasizes the value of skilled testing and encourages critical thinking, challenging traditional approaches. With his unwavering dedication, Bach has reshaped testing standards and inspired countless testers to think outside the box.<\/p><\/div><\/div><\/div><\/section> \u00a0<\/p> Learn more about James and his work<\/strong>:\u00a0Software Testing for Serious People - Satisfice, Inc.<\/a><\/p>","quoteUsername":"Kat","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote & Reply","Share":"Share"}}}"> 就像 报价和回复 分享 显示第一个帖子隐藏第一篇文章 28日回复 1 2 第二页/ 2 年代 西尔维奥 1回复 1个月前 2023年6月27日 这就跟你问声好！ 阅读任务的描述之后,我有怀疑的任务。是最高的停车费用。或最有趣的和极端的结果吗?都提到了。 我总是寻找极端结果所以我使用计算器,输入各种输入每个字段,其他字段保留为空。 我很快就发现,> = 11空格或> = 11或更多的特殊字符,计算器应用程序阻塞,发生一个拒绝访问的消息。> = 11位数或> = 11个字母,程序没有阻塞。这适用于所有字段。 参阅附上的信息。 西尔维奥•Cacace <\/figure> <\/figure> Hi!<\/p> \u00a0<\/p> After reading the description of the assignment, I had doubts about the exact assignment. Is it about the highest possible parking costs. Or the most interesting and extreme results? Both are mentioned.\u00a0<\/p> \u00a0<\/p> I am always looking for extreme results so I used the calculator and entered various inputs per field and left the other fields blank.<\/p> I soon found out that with >=11 spaces or >=11 or more special characters, the calculater app was blocked and an Access Denied message occurred. With >=11 digits or >=11 letters, the app did not blocked. This applies to all fields separately.<\/p> \u00a0<\/p> See the attached message.<\/p> \u00a0<\/p> Silvio Cacace<\/p>","quoteUsername":"Silvio","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote & Reply","Share":"Share"}}}"> 就像 报价和回复 C CindyATester 1回复 1个月前 2023年6月28日 待测试应用程序:停车计算器 URL:https://developsense.com/parkcalc/index.php 环境:Windows 11 | Google Chrome版本114.0.5735.134(官方构建)(64位)标准&隐身分别|使用VPN和荷兰的语言环境 测试会话:~ 1小时 推荐:基于问题下面&定价问题,这个功能不应该推到生产。 至关重要的 由于缺乏现场验证多个问题。重新创建了其他帖子的一些问题包括方法费用数万亿的感受为应用程序。 而不是尝试进一步的测试,将纠正实施现场验证,检查了js为页面。页面使用一个预发布版本的calc [8] https://www.rainforestnet.com/ 释放历史概述bug固定更多的当前版本。建议更新最新的稳定版本,重新测试。 https://www.rainforestnet.com/datetimepicker/datetimepicker-release.htm 至关重要的 由于缺少字段验证调用超时是可能的。超时将不太可能包括的字段验证很重要称之为另外由于自动检查的可能性将被证明是无效的。 超时时,页面完全崩溃,但调用返回200 OK。如果自动化测试只检查一个200 OK响应,他们会错误地报告传递。 1。不更新任何领域除了输入“9999999999”(不含引号)在离开日期字段 2。点击计算 需要更多的调试来确定根本原因,但能够再生产有11个1 9或10年代上面提到的步骤。 关键(用户体验) 点击计算,UI恢复短期很多将会混淆用户如果他们选择不同的很多。 1。很多>选择代客 2。日期输入> @明天上午8:00(使用日期选择弹出) 3所示。离开日期>后天@下午5:00(使用日期pikcer弹出) 4所示。点击计算 总计算和显示,但是UI恢复很多短期(第一个列表中),这是为用户混淆,再加上网络流量显示正确的URL中很多,但是显示不匹配的很多。 至关重要的 有效的用户界面输入恢复和更新可复合在点击计算不准确定价,字段更新在一个奇怪的模式。需要进一步调试。 1。离开很多作为默认选择(短期停车) 2。今天日期条目> @ 12:01pm(使用日期选择弹出) 3所示。离开日期>后天@ 1:01pm(使用日期选择弹出) 4所示。点击计算>离开更新25:01(24小时5点),单选按钮返回我 5。改变让单选按钮点(其他字段保留)>再次点击计算>更新37:01离开时间 这将继续改变点的单选按钮 关键(用户体验) 能够迫使日期选择导航和选择消极的年/前几年/无效日期选项 1。在入境日期字段YYYY替换为0001 2。没有按下< enter键> >点击日历按钮 3所示。当打开弹出日历>点击<按钮旁边 这将需要考虑现场验证的一部分——我们也想阻止用户选择一个日期的能力,验证失败。 问题:充满期待的价格是多少?下面是1小时,2小时和24小时。作为用户我预计价格经济长期小于表面和车库,但这似乎并不如此。 有特殊的公式代客泊车因为1 & 2小时的成本都是一样的吗?需要额外的测试与调查约定价(外的验证/阈值测试) 1小时 短期停车= 2美元 经济停车= 4美元 长期面= 2美元 长期车库= 2美元 代客= 12美元 2小时 短期停车= 4美元 经济停车= 8美元 长期面= 4美元 长期车库= 4美元 代客= 12美元 24小时 短期停车= 28美元 经济停车= 9美元 长期面= 10美元 长期车库= 12美元 代客= 42美元 额外的测试记录: 现场检查打开网站和检查日历在iOS移动Chrome和发现问题导航和视觉位置。需要考虑如果移动浏览器的使用是很重要的利益相关者和进一步的测试应该被起诉。 应该考虑其他利益相关者的期望,以及对实际行为评估。 Application Under Test: <\/strong>\u00a0PARKING CALCULATOR URL:<\/strong> \u00a0https:\/\/developsense.com\/parkcalc\/index.php<\/a> Environment: <\/strong>\u00a0Windows 11 | Google Chrome Version 114.0.5735.134 (Official Build) (64-bit) standard & incognito separately | Using a VPN with a locale of the Netherlands\u00a0 Test Session:<\/strong> ~ 1 hour<\/p> Recommendation:<\/strong>\u00a0 Based on issues outlined below & questions regarding pricing, this feature should not be pushed to production as is.\u00a0\u00a0\u00a0<\/p> Critical<\/strong> Multiple issues due to lack of field validation. \u00a0Recreated some of the issues outlined by other posts including ways to have fees in the trillions to get a feel for the application. Instead of attempting further tests that would be corrected by implementing field validation, checked the js for the page. \u00a0Page uses a pre-release version of the calc [.8] https:\/\/www.rainforestnet.com\/<\/a> The release history outlines bugs fixed in more current versions. \u00a0Recommend updating to the newest stable release and retest. https:\/\/www.rainforestnet.com\/datetimepicker\/datetimepicker-release.htm<\/a><\/p> <\/figure> \u00a0<\/p> Critical<\/strong> Due to the lack of field validation it is possible for the call to timeout. \u00a0Where the timeout would be less likely by including field validation it is important to call this out separately due to the possibility that automated checks would prove invalid. When the timeout occurs, the page fully crashes, but the call returns 200 OK. \u00a0If automated tests are only checking for a 200 OK response, they would falsely report as passing.<\/p> 1. Do not update any fields except enter \"9999999999\" (without quotes) in leaving date field\u00a0 2. Click Calculate Additional debug would be needed to determine root cause, but able to repro with 11 1s or 10 9s as mentioned in steps above.<\/p> <\/figure> \u00a0<\/p> Critical [UX]<\/strong> Upon clicking calculate, the UI reverts to Short Term Lot which will be confusing to a user if they had selected a different lot. 1. Lot > select Valet 2. Date Entry > Tomorrow @ 8:00am (using the date picker popup) 3. Date Leave > Day after tomorrow @ 5:00pm (using the date pikcer popup) 4. Click Calculate Total is calculated & displayed, \u00a0but the UI reverts the Lot to Short Term (the first in the list) which is confusing for the user, plus the network traffic shows the correct lot in the URL, but displays mismatched lots.<\/p> <\/figure> \u00a0<\/p> Critical<\/strong> Valid UI inputs revert & update which can compound to inaccurate pricing upon clicking Calculate, the fields update in an odd pattern. \u00a0Further debug required. 1. Leave Choose a Lot as the default (Short-Term Parking) 2. Date Entry > Today @ 12:01pm (using the date picker popup) 3. Date Leave > Day after tomorrow @ 1:01pm (using the date picker popup) 4. Click Calculate > Leave updates to 25:01 (24H 5pm), radio button reverts to AM 5. Change the Leave radio button to PM (leave everything else as is) > Click Calculate again > Leave time updates to 37:01 This will continue when changing the radio button to PM\u00a0<\/p> <\/figure> \u00a0<\/p> Critical [UX]<\/strong> Able to force the date picker to navigate & select negative years \/ previous years \/ invalid date options 1. In Entry Date field replace YYYY with 0001 2. Without pressing the <enter key> > Click the calendar button 3. When the popup calendar opens > click the < button next to the year\u00a0<\/p> This would need to be considered as part of field validation - we would also want to block the user from the ability to choose a date that would fail validation. \u00a0<\/p> <\/figure> \u00a0<\/p> Questions: <\/strong>\u00a0What is the expecation for pricing? \u00a0Outlined below is 1 hour, 2 hours & 24 hours. As a user I would expect the pricing for Economy to be less than Long Term Surface & Garage, but this does not appear to be the case. \u00a0 Is there a special formula for Valet parking since the cost of 1 & 2 hours is the same? \u00a0Additional testing & investigation is needed around pricing (outside of validation \/ threshhold testing)<\/p> 1 Hour Short-Term Parking = $2 Economy Parking = $4 Long Term Surface = $2 Long Term Garage = $2 Valet = $12<\/p> 2 Hours Short-Term Parking = $4 Economy Parking = $8 Long Term Surface = $4 Long Term Garage = $4 Valet = $12<\/p> 24 Hours Short-Term Parking = $28 Economy Parking = $9 Long Term Surface = $10 Long Term Garage = $12 Valet = $42<\/p> Additional testing notes:<\/strong><\/p> Spot checked opening the site and checking the calendar in iOS mobile Chrome and found issues with navigation & visual placement. \u00a0Would need to consider if mobile browser usage is important to stakeholders and if further testing should be pursued.<\/p> Other stakeholder expectations should be considered and evaluated against actual behavior.<\/p>","quoteUsername":"CindyATester","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote & Reply","Share":"Share"}}}"> 就像 报价和回复 Andrew_Clark 亚音速0.7 1回复 1个月前 2023年6月28日 宪章 玩停车计算器应用程序和报告的方法返回引用最高的停车数量。 开始 6/26/23 MST下午9:30 测试人员 安德鲁·克拉克 任务分解 持续时间:2小时 测试设计和执行:70 缺陷调查和报告:45 会话设置:5 测试记录 立刻发现了输入验证弱。您可以使用字母,不当格式化日期和时间、有趣的价值指数格式。 继续尝试不同的组合输入。您还可以修改URL的查询参数。 计算后,应用大型离开时间数量设置1.0 e + 304。要遵循这个,看看在哪里。 我继续给指数增加价值。有时我看到奶奶的反应或INF。如果这是观察到的我会试图增加价值较小的量,直到我遇到南响应(例1.051 e + 304)。 这让我想起了一个老游戏设计师原则,“双打”的规则。要调用这个启发式和用它来保证更大的数字。 (2.0806631388889 e + 303天0小时0分钟) 想休息。这是繁琐的手工操作的数字。玩的日期字段没有影响援引成本离开时间增加。 回到手工增加。花了一些时间试图操纵小时和分钟。我相信我已经刷爆了最可能数小时后大量的试验和错误。 (2.0806633505351 e + 303天,5.5440008598187 e + 288小时,0分钟) 这给了我一个想法来构建一个工具来自动计算的最大可能值。我可以建立一个脚本查询,检查如果响应是南,并调整下一个精确点要高,精度低,或移动到下一个点。重复直到我们筋疲力尽的可能性。 我达到一个点增加休假时间也没有设置较早进入时间影响上市成本。我相信我已经达到最大或非常接近它。 马克斯报价: 62419900516052628321919177177952942539179729818687810002347374663540381021158511193518099380091783699979767541880926834512254183774012033085310348596368569105579005780740154297306230727764160111324580765877870469842442802626135573727101397528326165006688640077818446085690142494295754810686230731673305088美元 (2.0806633505351 e + 303天,5.5440008598187 e + 288小时0分钟) 输入: 入境日期&时间:0:00 6/27/23(日期并不重要) 离开日期&时间:4.0102587079508772682714375 e + 304:5.9E + 305 6/27/23(日期并不重要) 选择代客泊车。这是很重要的。使用它!它的一个简单的报价乘数。记住这个被重置后计算。 错误 后点保存按钮不是计算成本。这也增加了离开的时间下午12分钟后选择进入或离开字段。 的选择选择很多下拉后不会保留运行计算。 您可以修改URL的查询参数和设置无效的日期和时间(例&EntryDate = 2 f17 % 2 f2006 20%——今年17日在20月2006) 思想实验 我知道问这里是找到引用的成本最高,但我刚完成詹姆斯RST风险类,这让我想到受害者(顺便说一句,你应该吃皇家莎士比亚剧院类如果你还没有,它改变了我的生活)。从机场的角度来看,他们也可能伤害的人这样的应用程序。在这个思想实验,我认为机场必须遵守他们报价(显然他们不会,但这是为了好玩)。 做一些研究在大急流城机场(从詹姆斯早期的评论),和戳在停车场网页,你会发现这个应用程序是在服务在2006年6月和2015年7月之间。 https://web.archive.org/web/20060617125320/http: / /www.grr.org/ParkCalc.php https://web.archive.org/web/20150706144049/http: / /www.grr.org/ParkCalc.php 虽然数字是不深刻的,你可以操纵的计算器,以确保你支付0美元9年(估计时间这个程序是可用的)。 现在,如果我们看看从机场最高成本的角度来看,他们损失了25美元k。力量! Charter<\/h3> Play with the Parking Calculator application and report the method for\u00a0returning the highest quoted amount for parking.<\/p> Start<\/h3> 6\/26\/23 9:30 PM MST<\/p> Tester<\/h3> Andrew Clark<\/p> Task Breakdown<\/h3> Duration: 2 hours<\/p> Test Design and Execution: 70<\/p> Bug Investigation and Reporting: 45<\/p> Session Setup: 5<\/p> Test Notes<\/h3> Immediately found the input validation to be weak. You can use letters, improperly formatted dates and times, interesting values in exponential format.<\/p> Continued trying different combinations of input. You can also modify the URL\u2019s query parameters.<\/p> After calculating, the app set my large\u00a0leave time number to be\u00a01.0E+304. Going to follow this and see where it goes.<\/p> I\u2019m continuing to increase the given exponential value. Sometimes I see a response of NaN or INF. If this was observed I would attempt to increase the value by a smaller amount until I hit the NaN response (ex. 1.051E+304).<\/p> This reminds me of an old game designer principle, \u201cThe Rule of Doubles\u201d. Going to call this a heuristic and use it to keep making bigger numbers.<\/p> Up to\u00a0(2.0806631388889E+303 Days, 0 Hours, 0 Minutes)<\/p> Took a break. This is tedious manipulating the numbers by hand. Played with the date field which has little to no impact on the quoted cost as the the leave time increased.<\/p> Back to increasing the number by hand. Spent some time trying to manipulate hours and minutes. I believe I\u2019ve maxed out the most possible hours after plenty of trial and error.<\/p> Up to (2.0806633505351E+303 Days, 5.5440008598187E+288 Hours, 0 Minutes)<\/p> This gives me an idea to build a tool to automatically calculate the largest possible value here. I could build a script to make the query, examine if the response is NaN, and adjust the next precision point to be higher, lower, or move on to the next precision point. Repeat until we\u2019ve exhausted the possibilities.<\/p> I\u2019ve hit a point where increasing the leave time nor setting an earlier entry time\u00a0affects the quoted cost. I believe I\u2019ve hit the max or are very close to it.<\/p> Max Quote<\/strong>:<\/p> $62,419,900,516,052,628,321,919,177,177,952,942,539,179,729,818,687,810,002,347,374,663,540,381,021,158,511,193,518,099,380,091,783,699,979,767,541,880,926,834,512,254,183,774,012,033,085,310,348,596,368,569,105,579,005,780,740,154,297,306,230,727,764,160,111,324,580,765,877,870,469,842,442,802,626,135,573,727,101,397,528,326,165,006,688,640,077,818,446,085,690,142,494,295,754,810,686,230,731,673,305,088.00 (2.0806633505351E+303 Days, 5.5440008598187E+288 Hours, 0 Minutes)<\/p> Inputs:<\/p> Entry Date & Time: 0:00 6\/27\/23 (the date doesn\u2019t matter) Leaving Date & Time:\u00a04.0102587079508772682714375E+304:5.9E+305\u00a06\/27\/23 (the date doesn\u2019t matter)<\/p> Choose\u00a0Valet Parking<\/strong>. This is important. Use it!\u00a0Its an easy quote multiplier. Remember this gets reset after each calculation.<\/p> <\/figure> \u00a0<\/p> Bugs<\/h3> The PM button is not preserved after calculating the cost. This also increases the leaving time by 12 minutes after selecting PM for either entry or leaving fields.<\/li>\t The selection in the Choose a Lot <\/strong>dropdown is not preserved after running a calculation.<\/li>\t You can modify the URL\u2019s query parameters and set invalid dates and times (ex.\u00a0&EntryDate=20%2F17%2F2006 - the 17th day in the 20th month of the year 2006)<\/li><\/ul> Thought Experiment<\/h3> I know the ask here was to find the highest quoted cost, but I just finished James\u00a0RST Risk class and this got me thinking about victims (btw, you should take the RST classes if you haven\u2019t already - it changed my life). From the airport\u2019s perspective, they could also be someone who is harmed by an app like this. In this thought experiment, I assumed the airport must honor what they quote (obviously they wouldn\u2019t, but this was for fun).<\/p> Doing some research on the Grand Rapids Airport (from James\u00a0earlier comment), and poking around their parking web pages, you will find this exact application was in service between June of 2006 and July 2015. https:\/\/web.archive.org\/web\/20060617125320\/http:\/\/www.grr.org\/ParkCalc.php https:\/\/web.archive.org\/web\/20150706144049\/http:\/\/www.grr.org\/ParkCalc.php<\/a><\/p> <\/figure> Although the numbers are not profound, you can manipulate the calculator to ensure you pay zero dollars for a 9 year period (the estimated time this app was available).<\/p> <\/figure> Now, if we look at the highest cost from the airport\u2019s perspective, they lost out on $25k. Oof!<\/p> <\/figure> \u00a0<\/p>","quoteUsername":"Andrew_Clark","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote & Reply","Share":"Share"}}}"> 就像 报价和回复 1 2 第二页/ 2 回复 由Gainsight ShiftSync条款和条件 报名 已经有一个帐户吗?登录 用户名(之后不能修改)* 电子邮件地址* 名字* 姓 (私人) 只有你和版主可以看到这些信息 * 密码* 我同意接收营销传播根据隐私政策并同意Tricentis188金宝搏app苹果下载软件一般使用条款。 loginBox.register.email_repeat 注册 登录到社区 还没有账户?创建一个帐户 用户名或电子邮件 密码 记得我 登录 忘记了密码? 输入您的用户名或电子邮件地址。我们将送你一个电子邮件与指令重置你的密码。 用户名或电子邮件 发送 回到概述 病毒扫描文件。 对不起,我们仍然检查这个文件的内容,以确保它是安全的下载。请几分钟后再试一次。 好吧 这个文件不能下载 对不起,我们的病毒扫描器发现下载这个文件不是安全的。 好吧 Learn more about our cookies.<\/a>","cookiepolicy.button":"Accept cookies","cookiepolicy.button.deny":"Deny all","cookiepolicy.link":"Cookie settings","cookiepolicy.modal.title":"Cookie settings","cookiepolicy.modal.content":"We use 3 different kinds of cookies. You can choose which cookies you want to accept. We need basic cookies to make this site work, therefore these are the minimum you can select. Learn more about our cookies.<\/a>","cookiepolicy.modal.level1":"Basic Functional","cookiepolicy.modal.level2":"Normal Functional + analytics","cookiepolicy.modal.level3":"Complete Functional + analytics + social media + embedded videos"}}}"> 金宝搏app官网下载 不卖我的个人信息吗 隐私政策 法律信息 条款和条件 map