Seatext library

Can I Run A/B Tests Only on Pages Where SeaText Is Active?

Yes. SeaText running A/B tests only on pages where SeaText is active, so you can keep experiments contained to chosen landing pages. Activate the AI on the pages you want in the Main AI...

Yes. SeaText's built-in A/B testing runs only on pages where SeaText is active. You choose where the AI runs, and the A/B testing agent works within that scope. Pages outside the active set keep their current copy and do not produce variants.

What page-scoped testing means

Page-scoped testing means the experiment is limited to the pages you activate. It does not mean you need a separate tool, subdomain, or test environment. SeaText modifies page text in the browser on the canonical page URL, so the version visitors see is the version being tested.

Think of activation as a gate. The JavaScript may be installed across the site, but the AI is activated on your preferred pages. A/B tests are generated for those pages only.

Why scope tests to specific pages

Scoping protects sensitive pages. Checkout, account, and confirmation pages are not places where you want an unexpected headline experiment. Keeping them outside the active set avoids that risk.

Scoping also improves the quality of results. A page with consistent traffic can produce a useful signal. A page with almost no visits will make the test drag on. By choosing pages deliberately, you focus the test on where a change can actually move a metric.

If you ignore scoping, you lose that control. The tool can still do its job, but you cannot say exactly which pages were tested. That matters when you explain results to a team or plan the next change.

What counts as an active SeaText page

An active page has three things in place:

  1. The SeaText JavaScript is installed on the site.
  2. The page has been visited after installation so the AI can link to your account.
  3. You activated the AI on that preferred page in the Main AI Hub and adjusted the configuration.

For A/B testing, you also need the AI A/B Testing Agent active. It generates variants and scales the winners. Without the agent, the page can be active for other SeaText features without producing A/B tests.

Key facts at a glance

QuestionFact
Where do you activate SeaText?In the Main AI Hub, on the pages you prefer.
What creates variants?The AI A/B Testing Agent generates variants and scales the winners.
What content gets tested?Headlines, buttons, proof, and product copy on pages you already have.
Can you edit variants before launch?Yes, in Variants Edit by URL and language.
What is required after installation?Visit the site once and stay for at least 40 seconds to activate the AI.

Step-by-step: run an A/B test on selected pages

  1. Install the JavaScript snippet. In Thinkific, go to Admin Dashboard > Settings > Code & Analytics tab, paste the code in Site Footer Code, and save.
  2. Link the site to your account. Add the website address in the format www.example.com, then visit the site once and stay for 40 seconds.
  3. Wait for confirmation. You should see the website name next to the SEATEXT logo within about five minutes.
  4. Open the Main AI Hub and activate the AI on your preferred pages. Click Configuration to adjust parameters.
  5. Turn on the AI A/B Testing Agent for the active pages. The agent generates variants for testing.
  6. Review the variants in Variants Edit. Select the URL and language, then edit the wording if needed.
  7. Let the test run. SeaText tests the changes and keeps the version that sells more.

Options and trade-offs

ScopeGood forWatch out for
Single landing pageTesting one campaign promise with a clean readNeeds enough traffic to finish the test
Group of pagesComparing how one offer works across products or marketsMore variation per page can make results harder to interpret
All active pagesScaling a change you already validatedWider blast radius if a variant underperforms

Use a single page when you have a specific hypothesis. Use a group of pages when you want broader confirmation. Use all active pages only after a winning variant has earned it.

Expert perspective: what to check before you start

From a conversion research standpoint, the first question is not “which tool” but “where do I have enough traffic to get a clean read.” Start with pages that already receive consistent visits and have a clear goal, such as a headline change on a landing page or a CTA change on a product page.

Check the activation status first. If the page was never visited after the script was installed, the AI may not be linked to your account yet. The 40-second visit is a real requirement, not a formality. Without it, your A/B test can look active when it is actually waiting.

Then check the variants. The initial round is generated automatically, but you can edit it before the test launches. This is where most small issues get caught, such as a phrase that changes brand tone or a translation that is too literal.

Finally, decide before you launch what “winning” means. More clicks, more form starts, more add-to-carts. SeaText tracks results by page and version, so you can judge the variant by the metric you care about. If you only look at headline changes without a conversion goal, you will be guessing.

Limitations and edge cases

  • Page-scoped testing only works where SeaText is active. If a page is not activated, the A/B testing agent will not generate variants for it.
  • Activation is not instant. The integration guide describes a 40-second visit, a five-minute wait for the website name, and a support check if it does not appear after 10 minutes.
  • Automatic variants are a starting point. You should review them in Variants Edit before the test runs.
  • Low-traffic pages create slow tests, not impossible tests. Be realistic about how long a result will take.
  • Platform setup matters. The steps shown in the Thinkific integration guide are for pasting code into Site Footer Code. Other platforms may have a different installation location.

Common mistakes to avoid

MistakeWhy it happensFix
Activating the script but not the AI on the pageThe script install is visible; page activation is separateOpen the Main AI Hub and activate preferred pages
Starting a test on a page with almost no trafficIt seems harmlessChoose a page with enough consistent visits
Skipping the 40-second activation visitInstallation feels complete after saving the codeVisit the site, stay on the page, and wait for confirmation
Launching variants without reviewAutomatic variants are convenientCheck Variants Edit by URL and language

Words you will see in the dashboard

  • Preferred pages – the pages you choose during activation.
  • Configuration – settings where you adjust AI parameters.
  • Variants – different versions of copy generated for testing.
  • Variants Edit – the panel for reviewing or editing variants before they run.
  • AI A/B Testing Agent – the SeaText agent that generates variants and scales winners.

Frequently asked questions

Do I need a separate SeaText script for each page?

No. One script installation can cover the site. Page-level activation controls where the A/B tests run.

Will SeaText test checkout or account pages by default?

No. It tests pages where you activate the AI. If you do not activate those pages, they are not part of the test.

How do I stop a test on one page?

Go to Configuration in the Main AI Hub and adjust the active pages, or disable the AI A/B Testing Agent for that page. The exact control may vary by platform.

Can I edit SeaText's generated variants before the test starts?

Yes. Use Variants Edit, select the URL and language, then review or edit the variants.

What if the website name does not appear after installation?

Wait a few more minutes. The integration guide says to contact support if it does not appear after 10 minutes.

Does page-scoped testing affect my other marketing pages?

Only the pages you activate are included. Other pages keep their current copy until you choose to include them.

Further reading and comparison sources

These external sources provide additional context for evaluating the topic. Their inclusion is not an endorsement.

How SeaText can help

SeaText helps you run A/B tests on the pages you choose, not everywhere on your site. Install the JavaScript snippet once, activate the AI on your preferred pages in the Main AI Hub, and the AI A/B Testing Agent generates variants and scales the winners. You can review the initial variants in Variants Edit before the test goes live.

One requirement to plan for: after adding your website, visit it once and stay for at least 40 seconds so the AI activates and links to your account. That check takes less than a minute and prevents the “test runs nowhere” problem.