A/B Testing overview
Create link experiments, split traffic by weight, start and pause tests, and apply statistical winners.
Use A/B Testing to compare destination URLs on an existing Pointerly link. Traffic is split by variant weight; results accumulate until you pause, complete, or declare a statistical winner—and when a winner is found, its URL can be applied back to the link automatically.
What you'll do
- Open Dashboard → A/B Testing (requires the
ab_testingfeature) - Create a test bound to a link that does not already have an A/B test
- Configure variants (2–5), traffic weights (must sum to 100%), and a goal metric
- Start, pause, resume, or complete the test from the list or detail dialog
- Check for a winner when enough sample and confidence are met
Before you start
- Plan includes A/B Testing (otherwise you see an upgrade block)
- You are in the correct team workspace
- At least one tracked link exists and is not already attached to another A/B test
- You know which URLs you want to compare (control keeps the link’s original URL)
Image placeholder — add `images/overview-cover.png` under this category
Steps
1. Open A/B Testing
- Go to Dashboard → A/B Testing.
- Confirm the page header shows A/B Testing with description Test different link variations to optimize conversions.
- Use search and the status filter (All / Draft / Running / Paused / Completed) to find existing tests.
Image placeholder — add `images/overview-step-01.png` under this category
2. Create a test
- Click Create Test (keyboard create shortcut is shown on the button when available).
- In Create A/B Test, select the Link to test. Only links without an existing
abTestIdappear. - Review Current URL for the selected link (this is the control destination).
- Set a Test name (auto-suggested from the product title or slug when you pick a link).
- Choose a Goal metric:
- Clicks (CTR) — optimize click-through
- Conversions — optimize conversion rate
- Revenue — optimize revenue per visitor
- Configure Variants (minimum 2, maximum 5):
- Control always uses the selected link’s original URL.
- Each additional variant needs a name, weight (1–99%), and alternative URL.
- Use Balance to redistribute weights evenly so they sum to 100%.
- Optional — open Advanced Settings:
- Confidence threshold (80–99%, default 95%)
- Minimum sample size (impressions per variant before analysis; default 100)
- Click Create Test. Pointerly creates the draft test and attaches it to the selected link.
Image placeholder — add `images/overview-step-02.png` under this category
3. Start, pause, and monitor
- From the test card menu (⋯) or the detail dialog:
- Draft → Start Test (status becomes Running)
- Running → Pause Test or Complete Test
- Paused → Resume Test or Complete Test
- Click a card to open the detail dialog for impressions, clicks, and per-variant results.
- While a test is Running, variants cannot be edited (weights and URLs are locked).
Image placeholder — add `images/overview-step-03.png` under this category
4. Declare a winner and apply the URL
- When enough traffic has accrued, use Check winner / complete with statistical evaluation from the detail flow.
- If confidence and sample size are met, Pointerly may complete the test and apply the winner URL to the linked short URL automatically.
- If there is not enough data yet, you will see a message to keep collecting traffic.
- You can also Complete Test manually without waiting for auto-winner selection.
Image placeholder — add `images/overview-step-04.png` under this category
Tips
- Test one meaningful change per experiment (landing page, marketplace, or offer URL)—not many unrelated changes at once.
- Keep early traffic balanced (50/50 or even splits) until you have a clear sample; skew weights later only if you must protect revenue.
- Prefer conversions or revenue as the goal when clicks alone do not reflect monetization.
- Raise minimum sample size for high-traffic links so a few bursts do not crown a false winner.
- A link can only participate in one A/B test at a time—finish or detach before starting another.
Troubleshooting
| Symptom | Likely cause | What to try |
|---|---|---|
| Upgrade block instead of page | Plan lacks ab_testing | Billing → Upgrade |
| “No links available” in create dialog | All links already have an A/B test, or none exist | Create a new link, or complete/delete the old test |
| Weights rejected / red total | Weights do not sum to 100% | Use Balance, or adjust sliders until total is 100% |
| Cannot change variants | Test is Running | Pause or complete first, then edit in a new draft if needed |
| “No winner yet” | Below confidence or sample threshold | Keep the test running; lower thresholds only if you accept more risk |
| Winner URL not applied | Manual complete without winner, or incomplete link association | Re-check detail dialog; confirm the test is still attached to the link |