Safety by Design
Safety by Design (SbD) is an eSafety initiative that encourages organisations to put user safety and rights at the centre of the design, development and release of online products and services.
Safety by Design emphasises the need to address online harms, alongside user safety and rights, in the product development lifecycle so that safety is systematically embedded into the culture and operations of organisations.
Safety by Design is proactive, preventative and focused on culture and leadership. It emphasises accountability and enables more positive, civil and rewarding online experiences.
Work on SbD began in 2018 and is based on extensive research and consultation.
Safety by Design principles
At the heart of Safety by Design is a set of principles. These are a model for industry of all sizes and stages of maturity, providing guidance as they incorporate, assess and enhance user safety. The principles position user safety as a fundamental design consideration.
Principle 1: Service provider responsibilities
The burden of safety should never fall solely upon the end user. Service providers can take preventative steps to ensure that their service is less likely to facilitate, inflame or encourage illegal and inappropriate behaviours.
To help ensure that known and anticipated harms have been evaluated in the design and provision of an online service, a service should take the following steps:
- Nominate individuals, or teams—and make them accountable—for user-safety policy creation, evaluation, implementation, operations.
- Develop community standards, terms of service and moderation procedures that are fairly and consistently implemented.
- Put in place infrastructure that supports internal and external triaging, clear escalation paths and reporting on all user-safety concerns, alongside readily accessible mechanisms for users to flag and report concerns and violations at the point that they occur.
- Ensure there are clear internal protocols for engaging with law enforcement, support services and illegal content hotlines.
- Put processes in place to detect, surface, flag and remove illegal and harmful conduct, contact and content with the aim of preventing harms before they occur.
- Prepare documented risk management and impact assessments to assess and remediate any potential safety harms that could be enabled or facilitated by the product or service.
- Implement social contracts at the point of registration. These outline the duties and responsibilities of the service, user and third parties for the safety of all users.
- Consider security-by-design, privacy-by-design and user safety considerations which are balanced when securing the ongoing confidentiality, integrity, and availability of personal data and information.
Principle 2: User empowerment and autonomy
The dignity of users is of central importance, with users’ best interests a primary consideration.
The following steps will go some way to ensure that users have the best chance at safe online interactions, through features, functionality and an inclusive design approach that secures user empowerment and autonomy as part of the in-service experience.
Services should aim to:
- Provide technical measures and tools that adequately allow users to manage their own safety, and that are set to the most secure privacy and safety levels by default.
- Establish clear protocols and consequences for service violations that serve as meaningful deterrents and reflect the values and expectations of the user base.
- Leverage the use of technical features to mitigate against risks and harms, which can be flagged to users at point of relevance, and which prompt and optimise safer interactions.
- Provide built-in support functions and feedback loops for users that inform users on the status of their reports, what outcomes have been taken and offer an opportunity for appeal.
- Evaluate all design and function features to ensure that risk factors for all users— particularly for those with distinct characteristics and capabilities—have been mitigated before products or features are released to the public.
Principle 3: Transparency and accountability
Transparency and accountability are hallmarks of a robust approach to safety. They not only provide assurances that services are operating according to their published safety objectives, but also assist in educating and empowering users about steps they can take to address safety concerns.
To enhance users’ trust, awareness and understanding of the importance of user safety, services should:
- Embed user safety considerations, training and practices into the roles, functions and working practices of all individuals who work with, for, or on behalf of the product or service.
- Ensure that user-safety policies, terms and conditions, community standards and processes about user safety are visible, easy-to-find, regularly updated and easy to understand. Users should be periodically reminded of these policies and proactively notified of changes or updates through targeted in-service communications.
- Carry out open engagement with a wide userbase, including experts and key stakeholders, on the development, interpretation and application of safety standards and their effectiveness or
- Publish an annual assessment of reported abuses on the service, alongside the open publication of meaningful analysis of metrics such as abuse data and reports, the effectiveness of moderation efforts and the extent to which community standards and terms of service are being satisfied through enforcement metrics.
- Commit to consistently innovate and invest in safety-enhancing technologies on an ongoing basis and collaborate and share with others safety-enhancing tools, best practices, processes and technologies.
Find advice and resources to help investors and venture capitalists ensure online platforms and services are safe for users. Making online safety a priority can build investor and customer trust, giving businesses a market lead that supports financial success.
Industry self assessment tools
Find out about eSafety's development of dynamic and interactive SbD self-assessment tools — one for start-ups, and another geared to the needs of more established companies. The modules help organisations to implement SbD effectively, sustainably and with the greatest impact.
Safety by Design timeline
Learn about the evolution of our world-leading Safety by Design initiative, including industry consultation and stakeholder engagement.