Evaluation

Usability testing results and analysis.

This page presents the usability testing content from the uploaded analysis document, including participant background, task settings, quantitative results, SUS analysis, and feedback summary.

Source: Usability Testing results analysisParticipants: 3Method: Task testing + SUS

Usability Testing

Test settings and participant background.

Test environment: All participants were in a quiet indoor setting and completed the entire test independently.

Participant

Zhiyuan.Liang

Age: 21

Job: University Student

Engineering student, proficient in using computers.

Participant

Yongzhi.Chen

Age: 51

Job: Office Worker

With many years of work experience and an interest in new things.

Participant

Yiyi.Kou

Age: 30

Job: University Teaching Assistant

Has many years of teaching experience in the field of computer science

Informed Consent Form: Zhiyuan.Liang, Yongzhi.Chen, Yiyi.Kou

Main Task List

Three core tasks were used to evaluate information access and inquiry support.

  • Task 1: Understand the overall information of Maple Bridge Scenic Area. Please find what kind of place Fengqiao Scenic Area is and what its historical and cultural values are.
  • Task 2: Find transportation options to Fengqiao. Please search on the website for how to get by subway and how to get by bus.
  • Task 3: Locate the entry point for scenic area inquiries and assistance. Please find the scenic area consultation phone number and ticketing/opening hours related information prompts.

Quantitative Data

Task completion and SUS results.

The completion status of the core testing tasks by the participants
ParticipantCompletion TimeTask Completion RateError Rate
Zhiyuan.Liang141s100%0%
Yongzhi.Chen180s100%0%
Yiyi.Kou175s100%0%
Average Value165.333s100%0%

SUS Score

Participant-level SUS scores.

The SUS common ten-item score for participants
Participant12345678910Total score of SUS
Zhiyuan.Liang425142524185
Yongzhi.Chen415242524282.5
Yiyi.Kou525152524190
Variance0.30.300.30.300000.314.85
Mean4.31.75.01.34.32.05.02.04.01.385.83

Analysis Of The Results Of SUS

The SUS results indicate strong usability with several refinement opportunities.

Excellent usability and learning efficiency

Q3 (ease of use): mean 5.00, variance 0.00; Q7 (learnability): mean 5.00, variance 0.00; Q8 (cumbersome feeling): mean 2.00, variance 0.00. Users unanimously agree that the system is intuitive and simple to operate.

Perceived system complexity needs to be reduced

Q2 (unnecessary complexity): mean 1.67, variance 0.33. A small number of users perceive slight complexity; simplifying operation paths and lowering cognitive load is suggested.

Stable and outstanding function integration & interface consistency

Q5 (function integration): mean 4.33, variance 0.33; Q6 (inconsistency): mean 2.00, variance 0.00. Functions are well-connected, the interface logic is consistentwith no confusing experience.

Strong independent operation confidence & usage intention

Q1 (usage intention): mean 4.33, variance 0.33; Q9 (operation confidence): mean 4.00, variance 0.00; Q4 (technical support dependence): mean 1.33, variance 0.33. Users are willing to use the system frequently and can operate it independently without technical assistance.

Onboarding learning cost can be further optimized

Q10 (pre-learning required): mean 1.33, variance 0.33. Some users still need minor learning to get started; enhanced onboarding guidance and one-step prompts are recommended.

Feedback Summary

Summarized modification suggestions from the usability testing questionnaire.

In addition to the SUS test, we also conducted a more detailed survey of the respondents and asked them to provide suggestions for modifications.

  1. We hope that the overall introduction of Fengqiao can be presented at the beginning to help everyone establish a basic understanding.
  2. The font size of the English title is a bit too large.
  3. The textual description of the transportation route is too brief.
  4. The ticket information is not presented in an intuitive manner. Perhaps more purchase channels and links could be added.
  5. The content on the homepage should present more valuable information rather than merely showing the temperature.
  6. It is hoped that the pictures in the photo wall can be zoomed in and out.
  7. No Visiting Instructions
  8. It is hoped that the recommended route can be combined with the scenic area map for presentation.
  9. The content on the homepage is too complicated.
  10. The intelligent Fengqiao is not very intelligent. It can only answer a limited number of questions.

Source: Usability Testing results analysis.docx

Iterative Refinement

Before-and-after refinements from the uploaded document.

Iteration 1

Before / After Refinement

Iteration 1 before screenshot
Before
Iteration 1 after screenshot
After

At the beginning of the web page, an overview of the scenic area and its historical introduction are designed to help users quickly form an overall impression of the area.

Iteration 2

Before / After Refinement

Iteration 2 before screenshot
Before
Iteration 2 after screenshot
After

Reduce the size of the English font by one level.

Iteration 3

Before / After Refinement

Iteration 3 before screenshot
Before
Iteration 3 after screenshot
After

The route details function has been added. By clicking the button, you can view more detailed route instructions in the pop-up window.

Iteration 4

Before / After Refinement

Iteration 4 before screenshot
Before
Iteration 4 after screenshot
After

Added the online ticket booking function, allowing users to directly navigate to the official ticket purchasing page for purchase.

Iteration 5

Before / After Refinement

Iteration 5 before screenshot
Before
Iteration 5 after screenshot
After

Moved the weather forecast function from the top of the page to the "Gaming Tips" section.

Iteration 6

Before / After Refinement

Iteration 6 before screenshot
Before
Iteration 6 after screenshot
After

Added the function of zooming in and out of photos. It can adjust the photo size by pressing the button, or you can directly use two fingers on the phone to make the adjustment.

Iteration 7

Before / After Refinement

Iteration 7 before screenshot
Before
Iteration 7 after screenshot
After

Added a "Visiting Instructions" section for tourists.

Iteration 8

Before / After Refinement

Iteration 8 before screenshot
Before
Iteration 8 after screenshot
After

After generating the personalized route, you can choose to view the route on the map. In this way, tourists can directly see on the map every scenic spot along the highlighted route as well as the sequence of visits.

Iteration 9

Before / After Refinement

Iteration 9 before screenshot
Before
Iteration 9 after screenshot
After

The top section of the page has been simplified. The lengthy text has been removed and replaced with a carousel of photos of Maple Bridge, making the entire web page more refreshing.

Iteration 10

Before / After Refinement

Iteration 10 before screenshot
Before
Iteration 10 after screenshot
After

The function of "Smart Maple Bridge" has been enhanced, enabling it to answer more questions.

Source: Iterative Refinement.docx

System Implications

Social and ethical implications of the Maple Bridge design.

Social Implications

Cultural and community value.

Cultural Preservation and Modern Dissemination

Our design plays a vital role in keeping history alive. By digitizing the rich historical, literary, and architectural heritage of Maple Bridge, such as the legacy of Zhang Ji's famous poem "A Night Mooring by Maple Bridge", we are making ancient culture accessible and engaging for a modern, potentially younger demographic. Features like the "Interactive Map" and "Photo Wall" transform passive sightseeing into an active, shared community experience.

Cross-Cultural Inclusivity and Tourism

The inclusion of a bilingual toggle (Chinese/English) has strong positive social implications. It breaks down language barriers, allowing international tourists to understand and appreciate local Suzhou culture. This not only promotes cross-cultural empathy and education but also supports the local tourism economy by making the scenic area welcoming to a broader audience.

Fostering Community and Ecological Awareness

Our platform highlights Maple Bridge not just as a tourist trap, but as a "city lung" and ecological space for local citizens. The "Notice Board" feature helps build a bridge between the scenic area management and the local community, keeping residents informed about events and park operations.

Ethical Implications

Equity, responsibility, and trust.

Accessibility and Bridging the Digital Divide

One of the strongest ethical choices in our design is the inclusion of an Elderly Mode. As digital guides become the standard for tourism, older generations are often left behind due to complex UIs or small text. Designing specifically for seniors demonstrates a commitment to digital equity, ensuring that technological advancement does not result in the exclusion of vulnerable user groups.

Promoting Responsible and Ethical Tourism

Through the "Visitor Guidelines" integrated into the platform, our design gently nudges users toward ethical behavior, such as respecting the environment, adhering to water safety, and restricting drone usage. As a UI/UX designer, we are using the platform to advocate for the physical preservation of the historical site, ensuring that increased foot traffic does not harm the ecosystem.

Data Privacy and AI Transparency

The inclusion of the Smart Agent and location-based services, like real-time weather and navigation, introduces important ethical considerations regarding user data. For this design to remain ethical, it is crucial that user location data is collected transparently, used only for necessary features, and not exploited. Furthermore, the AI assistant must be designed to provide accurate, unbiased historical information without hallucinating facts, ensuring users are educated truthfully.

Source: Reflection.txt

Technical Reflection

Reflecting on AI-assisted logic generation, verification, and ethical safeguards.

1. Core Logic Generating

Prompting AI for a lightweight Maple Bridge architecture.

I am a student of a human centered development course, and the task of the course is to develop a webpage about Fengqiao.

Based on our user survey, we have designed the following features:

  • Interactive map with external map API
  • Photo Wall for Displaying Photos
  • Billboard displaying announcements
  • Intelligent Q&A with external AI

We need you to think about an architecture that meets the following conditions:

  • Ensure smooth page switching and image display
  • Modularity facilitates subsequent modifications and parallel development
  • Convenient and efficient, suitable for lightweight products

2. Code Verification

Testing AI-generated code across three levels.

The code that was generated by AI was tested at unit, integration, and system levels.

Testable processing:

Unit Testing

For unit testing, the route recommendation function was tested independently to ensure that a specific combination of duration and preference, such as “90 minutes” and “historical route”, returned the correct route.

Integration Testing

For integration testing, the route-selection UI was tested together with the recommendation logic to confirm that clicking the time and preference buttons correctly updated the recommendation panel.

System Testing

For system testing, an end-to-end test simulated a complete user journey: entering the interactive map page, selecting a recommended route, checking the result, and navigating to the photo wall page.

3. Ethical Considerations

Responsible use of AI during development.

Human Review of AI Outputs

During the project development process, AI mainly helped us generate coding ideas, webpage text, image style prompts, video scripts, and analysis frameworks. However, all AI-generated outputs were reviewed and revised by team members.

We did not directly copy AI results as the final outcome. Instead, we selected and adjusted them according to the project requirements, user feedback, and the actual functions of the website.

This reflects the principle of human oversight. In other words, AI provided suggestions, but the final decisions were made by the team. UNESCO also emphasizes that AI systems should maintain human supervision and accountability.

Avoiding Copyright and Intellectual Property Issues

In visual generation, we did not ask AI to directly imitate specific artists, commercial brands, films, or copyrighted visual styles. Instead, the generated images and videos focused on general cultural atmosphere, such as “Jiangnan ancient town”, “warm sunset lighting”, “red maple elements”, and “traditional architectural layers”, rather than copying any existing work.

In webpage development, AI-generated code was also manually integrated and modified by the team. This ensured that the code served our own project structure instead of simply copying other websites. In this way, we reduced copyright risks and maintained the originality of the project.

Avoiding Fabricated Data or False Conclusions

During the project analysis stage, AI helped us organise questionnaire feedback, summarise user needs, and identify possible PBIs and optimisation directions. However, we did not allow AI to fabricate user feedback, testing results, or project conclusions.

Therefore, our responsible approach was as follows:

  • AI assisted with summarisation, while the team verified the sources.
  • AI suggested possible directions, while the team decided priorities based on real feedback.
  • AI helped polish the writing, while the team ensured that the content remained consistent with the actual project.

Sources: 1.txt, 2.txt, 3.txt, 4.txt, 5.txt, 6.txt

Citation

AI tools and generated media sources used in the project.

  1. [1] ChatGPT 5.5, accessed on 2026-04-17, abailable at https://chatgpt.com/. Used for producing the code of the prototype.
  2. [2] Doubao Seedance 2.2 Fast, accessed on 2026-05-03, available at https://doubao.com/. Used for producing the trailer.
  3. [3] Doubao Seedream 4.5, accsessed on 2026-04-12, available at https://doubao.com/. Used for producing the brand picture.
  4. [4] Doubao Seedream 4.5, accsessed on 2026-04-12, available at https://doubao.com/. Used for producing the poem picture & stickbox picture.

Source: docs/Citation.txt