{"id":10346,"date":"2025-06-08T23:47:01","date_gmt":"2025-06-08T22:47:01","guid":{"rendered":"https:\/\/stevepedwards.today\/DebianAdmin\/?p=10346"},"modified":"2025-07-03T17:35:18","modified_gmt":"2025-07-03T16:35:18","slug":"clean-up-duplicate-posts-gem-ai","status":"publish","type":"post","link":"https:\/\/stevepedwards.today\/DebianAdmin\/clean-up-duplicate-posts-gem-ai\/","title":{"rendered":"Clean Up Duplicate Posts – Gem AI"},"content":{"rendered":"
<\/div>\n

<\/path><\/svg><\/i> \"Loading\"<\/p>\n

<\/div>\n
    \n
  1. \n

    Identify Duplicate Slugs:<\/strong><\/p>\n

      \n
    • Go to the wp_posts<\/code> table (your table prefix might be different, e.g., wp_xyz_posts<\/code>).<\/li>\n
    • Look at the post_name<\/code> column. You're looking for entries like my-post<\/code>, my-post-2<\/code>, my-post-3<\/code>, etc., where the content is essentially the same or one is an older, now-obsolete version.<\/li>\n
    • You can run SQL queries to help identify these. For example:\n
      \n
      \n

      SQL<\/span><\/p>\n

      mysql> SELECT post_name, COUNT(*) as count
      \n-> FROM wp_xubg_posts
      \n-> WHERE post_status IN ('publish', 'draft', 'private') -- or just 'publish' if that's all you want to check
      \n-> GROUP BY post_name
      \n-> HAVING count > 1;
      \n+-------------------------------------------------------+-------+
      \n| post_name | count |
      \n+-------------------------------------------------------+-------+
      \n| some-linux-one-line-cmds | 2 |
      \n| linux-admin-webdev-beginner-to-intermediate-it-topics | 3 |
      \n| win11-to-wsl2-networking-chat-with-gemini-ai-2025 | 2 |
      \n+-------------------------------------------------------+-------+
      \n3 rows in set (0.02 sec)<\/div>\n
      <\/div>\n
      To delete leaving most recent entry:<\/div>\n<\/div>\n<\/div>\n
      \n
      \n
      \n
      DELETE p1\r\nFROM wp_xubg_posts p1\r\nJOIN wp_xubg_posts p2 ON p1.post_name = p2.post_name\r\nWHERE p1.ID < p2.ID\r\nAND p1.post_status IN ('publish', 'draft', 'private'); -- Adjust post_status as needed\r\n<\/code><\/pre>\n<\/div>\n<\/div>\n<\/div>\n
      view the 134 WANTED Posts currently in the DB:<\/p>\n
      Step 1: Preview the Posts\/Pages to be Deleted<\/b><\/h3>\n
       <\/p>\n
      Before deleting, run this SELECT<\/code> query to see exactly which posts and pages (by ID<\/code>, post_title<\/code>, post_type<\/code>, and post_status<\/code>) will be affected. This will help you confirm that you're targeting the correct content.<\/p>\n
      \n
      \n
      SQL<\/span><\/p>\n
      <\/div>\n<\/div>\n
      \n
      \n
      SELECT<\/span> ID, post_title, post_type, post_status\r\nFROM<\/span> wp_xubg_posts\r\nWHERE<\/span> post_type IN<\/span> ('post'<\/span>, 'page'<\/span>) AND<\/span> post_status !=<\/span> 'publish'<\/span>;\r\n<\/code><\/pre>\n<\/div>\n<\/div>\n<\/div>\n
      Review the output carefully. If it lists the posts and pages you expect to remove, proceed to the next steps.<\/p>\n
      \n
       <\/p>\n
      Step 2: Delete Associated Comments<\/b><\/h3>\n
       <\/p>\n
      This command will delete all comments linked to the posts and pages that are not in the 'publish' status.<\/p>\n
      \n
      \n
      SQL<\/span><\/p>\n
      <\/div>\n<\/div>\n
      \n
      \n
      DELETE<\/span> FROM<\/span> wp_xubg_comments\r\nWHERE<\/span> comment_post_ID IN<\/span> (\r\n    SELECT<\/span> ID\r\n    FROM<\/span> wp_xubg_posts\r\n    WHERE<\/span> post_type IN<\/span> ('post'<\/span>, 'page'<\/span>) AND<\/span> post_status !=<\/span> 'publish'<\/span>\r\n);\r\n<\/code><\/pre>\n<\/div>\n<\/div>\n<\/div>\n
      \n
       <\/p>\n
      Step 3: Delete Associated Post Metadata<\/b><\/h3>\n
       <\/p>\n
      This command will delete all post metadata (custom fields, etc.) linked to the posts and pages that are not in the 'publish' status.<\/p>\n
      \n
      \n
      SQL<\/span><\/p>\n
      <\/div>\n<\/div>\n
      \n
      \n
      DELETE<\/span> FROM<\/span> wp_xubg_postmeta\r\nWHERE<\/span> post_id IN<\/span> (\r\n    SELECT<\/span> ID\r\n    FROM<\/span> wp_xubg_posts\r\n    WHERE<\/span> post_type IN<\/span> ('post'<\/span>, 'page'<\/span>) AND<\/span> post_status !=<\/span> 'publish'<\/span>\r\n);\r\n<\/code><\/pre>\n<\/div>\n<\/div>\n<\/div>\n
      \n
       <\/p>\n
      Step 4: Delete the Posts and Pages Themselves<\/b><\/h3>\n
       <\/p>\n
      Finally, this command will delete the actual post and page entries that are not in the 'publish' status.<\/p>\n
      \n
      \n
      SQL<\/span><\/p>\n
      <\/div>\n<\/div>\n
      \n
      \n
      DELETE<\/span> FROM<\/span> wp_xubg_posts\r\nWHERE<\/span> post_type IN<\/span> ('post'<\/span>, 'page'<\/span>) AND<\/span> post_status !=<\/span> 'publish'<\/span>;\r\n<\/code><\/pre>\n<\/div>\n<\/div>\n<\/div>\n
      \n
      After running these commands, you can run the SELECT<\/code> query from Step 1 again, and it should return an empty set if all non-published posts and pages have been successfully removed. Your attachments should still be present in the media library, although they might appear as \"unattached\" if their parent posts were deleted.<\/p>\n
      This gives a list of Posts with their publish date:SELECT ID, post_title, post_date
      \nmysql> SELECT ID, post_title, post_date FROM wp_xubg_posts WHERE post_type IN ('post', 'page') AND post_status = 'publish';
      \n+-------+------------------------------------------------------------------------------------------------------------+---------------------+
      \n| ID | post_title | post_date |
      \n+-------+------------------------------------------------------------------------------------------------------------+---------------------+
      \n| 10526 | Old Main Page - Linux Admin & WebDev | 2014-04-02 15:31:26 |
      \n| 2055 | Notepad | 2015-08-30 22:18:39 |
      \n| 3843 | File Downloads | 2016-08-06 22:21:13 |
      \n| 3863 | Brief History of Unix\/Hackerdom | 2016-08-07 23:48:59 |
      \n| 4339 | Awk\/Perl\/SED Notepad | 2016-08-21 21:16:07 |
      \n| 5456 | Steve Edwards CV | 2016-10-31 21:11:22 |
      \n| 8869 | Databases \u2013 My Research Paper 2009 | 2019-12-15 07:43:48 |
      \n| 8565 | Statistical Investigation of Aloha Packet Radio Transmission | 2020-01-03 10:52:18 |
      \n| 8871 | 5 Day Linux Introduction Course | 2020-01-26 06:11:54 |
      \n| 10245 | Windows Powershell Commands | 2025-05-31 00:56:57 |
      \n| 10270 | Linux History Examples 2025 | 2025-05-31 08:57:33 |
      \n| 10412 | AI Powered Semantic Posts Search | 2025-06-28 01:18:23 |
      \n| 10527 | Linux, Windows, Comms, IT and AI Topics | 2025-06-28 01:18:23 |
      \n| 10463 | LLM WSL2 Services Start Command | 2025-06-30 06:14:08 |
      \n| 10118 | Databases \u2013 A Research Paper 2009 | 2009-03-01 02:53:46 |
      \n| 53 | Re-install Win 7 With No DVD and Replace Laptop Auto Recovery Partition | 2014-04-05 11:29:15 |
      \n| 146 | Cool Command #1 - DD with Progress | 2014-04-09 17:41:20 |
      \n| 181 | Cool Command #2, Find with -exec or -delete or pipe to xargs rm -v | 2014-04-13 02:21:50 |
      \n| 230 | Cool Command #3 Rsync | 2014-04-17 17:10:23 |
      \n| 286 | Simple WordPress CSS Text Size and Color Tweaks | 2014-04-20 02:38:50 |
      \n| 319 | William Shotts SysInfo.html Creator Script | 2014-04-21 16:57:07 |
      \n| 410 | Basic Security Concepts - Principles For Any System or OS | 2014-11-09 20:37:43 |
      \n| 412 | Recover Your Data and PC | 2014-11-09 20:43:40 |
      \n| 772 | File Recovery with TestDisk + Photorec | 2014-11-27 20:13:29 |
      \n| 776 | Cool Cmd #6 - dd_rescue | 2014-11-27 20:35:05 |
      \n| 863 | Cryptography + Encryption | 2015-01-10 19:49:18 |
      \n| 978 | Linux Commands + Packages - How Many, and What For? | 2015-01-29 21:18:29 |
      \n| 1075 | Basic Maths and Ideas Behind Password Complexity | 2015-02-24 01:25:20 |
      \n| 1322 | Setup and Access a 1TB FAT32 USB Share on a Draytek Router | 2015-07-10 21:48:39 |
      \n| 1469 | Mint as a PXE Server for PartedMagic and Multi OSs | 2015-07-25 01:56:35 |
      \n| 1540 | PXE Menu Issues and ISO Boot File Problems | 2015-07-31 14:39:34 |
      \n| 1603 | AVCONV Video Format Conversion Command Line Structure | 2015-08-03 15:28:31 |
      \n| 1624 | First Python Scripts For Pi Camera | 2015-08-04 21:12:06 |
      \n| 1697 | Testing Webcams With fswebcam, Pi Noir Picam and Remote View of Motion on the Pi | 2015-08-09 03:14:24 |
      \n| 1787 | Working Motion Installs On 2 Identically Setup Pi2's | 2015-08-11 15:06:35 |
      \n| 1805 | Using Sendemail + Curl For a Motion Alert and Hacking Its 2+ year old Perl TLS Bug | 2015-08-13 15:47:21 |
      \n| 1915 | Adding a SSH Share Using SSHFS and Viewing Netstat | 2015-08-20 16:07:32 |
      \n| 1941 | Using Awk, Sed, Cut and TR To Cut a Column List for Character Substitution and Nmap Bad Ports List | 2015-08-21 20:57:50 |
      \n| 2007 | Basic Rsync Usage Summaries from Man Page | 2015-08-23 12:32:39 |
      \n| 2026 | Fix Double Minus Sign Problem in WordPress in Theme Functions php | 2015-08-24 11:30:53 |
      \n| 2087 | Cool Command #8 - lsof | 2015-08-31 11:39:34 |
      \n| 2219 | Using and finding the attribute of i assigned to a file with chattr and lsattr | 2015-09-09 16:11:41 |
      \n| 2226 | Understanding Basic Ideas Behind Optimised Code and Erastosthenes Sieve | 2015-09-10 23:36:41 |
      \n| 2274 | Using Crontab to Automate Commands on Schedule and with Poweroff | 2015-09-17 19:27:40 |
      \n| 10122 | Some Linux One Line Cmds | 2015-09-24 03:00:55 |
      \n| 2354 | SED Basics using O_Reilly.pdf example, and Unexpected Mind-Bending Parsing Behaviour | 2015-10-01 18:17:18 |
      \n| 2373 | When students ask: What's an IP Address? | 2015-10-20 14:19:16 |
      \n| 2414 | Home Made Outdoor Surveillance PiCams, Pi Cam's IR Sensitivity, with TalkTalk Powerline | 2015-10-28 21:14:09 |
      \n| 2555 | Issues Writing with DD to dev_sr0 With Blank DVDs | 2015-11-10 10:13:20 |
      \n| 2668 | Encapsulation - From Bits to Gigabytes in 200 Years | 2016-03-17 21:46:51 |
      \n| 2891 | Testing graphics (PCIE) cards with phoronix-test-suite | 2016-03-28 22:19:34 |
      \n| 2972 | Cool Command #10 - mogrify | 2016-04-25 17:17:22 |
      \n| 3020 | Multi Picam Webserver | 2016-05-26 23:26:32 |
      \n| 3051 | Chapters 1-4 Notes - Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-06 16:54:45 |
      \n| 8885 | Chapter 5 Notes \u2013 Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-07 14:53:32 |
      \n| 3070 | Chapter 6 Notes Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-07 23:35:25 |
      \n| 8887 | Chapter 7 Notes \u2013 Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-08 18:09:26 |
      \n| 3097 | Chapter 8 Notes Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-09 23:55:36 |
      \n| 3198 | Creating an eBook PDF from your WordPress Posts | 2016-06-23 19:44:48 |
      \n| 3212 | Chapter 9 Notes Practical C Programming, 3rd Edition By Steve Oualline | 2016-06-25 13:00:06 |
      \n| 3236 | Practical C Programming - Switch and Nested Switches Example | 2016-06-26 17:01:31 |
      \n| 3264 | Practical C Programming - Unitsconverter Prog: using fmod for float remainder | 2016-06-28 21:43:22 |
      \n| 3306 | Post New Mint Install Tweaks Options | 2016-07-01 16:22:41 |
      \n| 3315 | Experiment with Pipes, Redirection, Command Substitution and Variable Expansion | 2016-07-04 02:21:32 |
      \n| 3344 | Setting Sudo Users with Adduser and Visudo in Mint and Raspbian | 2016-07-06 01:02:54 |
      \n| 3404 | Remote Server gkrellm Monitors or Other GUI Apps via SSH and X11 | 2016-07-09 23:52:50 |
      \n| 3450 | Exploring Find Cmd Options - file types you may want to find...and go insane trying | 2016-07-14 19:00:33 |
      \n| 8890 | Exploring Find Cmd Options \u2013 Continuing With Metacharacters | 2016-07-22 00:18:09 |
      \n| 3831 | An Intro to Metachar Search Methods, Wreck the MP3s | 2016-08-06 17:50:12 |
      \n| 3944 | Intro to Gnuplot | 2016-08-10 23:42:28 |
      \n| 3962 | Flame Graphs by www.brendangregg.com - Intro to System Profiling and Admin Tools | 2016-08-11 19:31:02 |
      \n| 4027 | Linux Performance Tools List Check Utilisation, Saturation, Errors (USE) | 2016-08-13 13:27:14 |
      \n| 4041 | How Slow Can You Go? Old and New Tech Moore's Law Comparison - Hard Drives | 2016-08-14 22:36:40 |
      \n| 4145 | Gnuplot - Basic Starter Example Data File for System Profile Plots | 2016-08-17 15:36:29 |
      \n| 4188 | Gnuplot - Basic Ideas to Capture Live System Data | 2016-08-18 15:56:30 |
      \n| 4246 | How Slow Can You Go? Sysbench Comparisons - CPUs | 2016-08-20 16:04:29 |
      \n| 4262 | How Slow Can You Go? Sysbench Comparisons - Memory | 2016-08-20 18:08:01 |
      \n| 4281 | How Slow Can You Go? Sysbench Comparisons Disk\/File IO | 2016-08-20 19:29:10 |
      \n| 4302 | CPU Bound Loop to Load 1 CPU Core to 100% to Test Observability Tools | 2016-08-20 23:59:25 |
      \n| 10120 | Awk\/Perl\/SED Notepad | 2016-08-21 02:56:41 |
      \n| 4320 | Sysbench - Simulated Database Testing | 2016-08-21 15:47:56 |
      \n| 4463 | Converting m4a to mp3 | 2016-08-26 21:58:03 |
      \n| 4553 | Printing (LIVE!) ASCII Histograms from Numeric Data Output + Files | 2016-08-30 16:56:15 |
      \n| 4716 | Developing One Liners with Command Substitution | 2016-09-05 14:41:01 |
      \n| 4777 | AWK as a Limited Spreadsheet Simulation for Stats | 2016-09-13 09:43:26 |
      \n| 4838 | Save Gigabytes of Failed Rsync Video Transfers on a Drive | 2016-09-17 16:39:57 |
      \n| 4923 | Intro to Software Defined Radio - FM Stations and Tracking Aircraft | 2016-09-24 15:42:39 |
      \n| 5212 | Small Business Data Security Requirements Summary | 2016-10-18 13:19:54 |
      \n| 5864 | Cisco Setup via Linux - Serial Port Connection | 2017-01-09 17:45:05 |
      \n| 5914 | Cisco Setup ADSL Connection (WAN) | 2017-01-09 23:40:29 |
      \n| 5949 | Cisco Setup NAT Connections (LAN to WAN), ACLs, DNS and DHCP Server | 2017-01-10 16:50:32 |
      \n| 5985 | Cisco Setup ACL Settings and Basic Routing Concepts | 2017-01-10 23:37:21 |
      \n| 5995 | Cisco Setup WiFi LAN and NTP - Full Config + Password Reset + Webpage Access | 2017-01-11 00:21:22 |
      \n| 6075 | Slick Canon Printer Support for Linux - How Corporations Should Do It... | 2017-01-18 21:55:00 |
      \n| 6124 | Cheap But Handy USB\/SATA\/IDE Backup Gizmos from the Web | 2017-01-20 13:29:48 |
      \n| 6297 | DD and Cloning Windows System Drives | 2017-01-22 20:23:26 |
      \n| 6403 | Personal Data Awareness for Broken\/Stolen PCs - The Data People Give Away! Use Shred\/Other App | 2017-01-28 17:10:34 |
      \n| 6941 | Backing Up Working Picam Images Over the Net With dd and Netcat | 2017-02-22 09:11:24 |
      \n| 7099 | Check Working Keys Using Ubuntu's Handy Utility | 2017-03-08 13:36:47 |
      \n| 7361 | WordPress Upload Limit - .user.ini | 2017-09-08 20:08:25 |
      \n| 7451 | Booting a Pi3 from USB3 Devices | 2017-10-05 15:45:15 |
      \n| 7470 | Pi3 USB Boot Device with Picam Motion | 2017-10-05 18:17:29 |
      \n| 7729 | WP Info\/Search Replace on CMD Line\/vsftpd | 2018-01-24 02:00:39 |
      \n| 8627 | New Mint Install and Want WordPress at Home? Full Steps I Take...\u00a0 | 2018-01-24 02:00:39 |
      \n| 8626 | My Rsync Local WordPress Backup Examples (in Win11 I just use Syncback) | 2018-01-27 23:55:39 |
      \n| 7842 | Quickest Cloning of Working Mint System | 2019-06-28 01:39:11 |
      \n| 8583 | Rescue Your System from an MBR corruption? grub rescue> | 2019-06-28 02:19:29 |
      \n| 7855 | GParted's e2fsck -fyvC0 \/dev\/sdx and ntfsresize -ifv \/dev\/sdx | 2019-06-28 18:36:44 |
      \n| 8393 | Manipulating PDFs using PDFTK and PDF-Shuffler | 2020-01-01 06:05:14 |
      \n| 8431 | Thumbdrive Performance Differences V USB SATA disk | 2020-01-14 08:44:45 |
      \n| 8418 | Joining\/Sizing MP4 Video Files | 2020-01-25 04:59:26 |
      \n| 8628 | Converting DVD VOB Files to Smaller VOB and MKV with ffmpeg | 2020-07-29 21:25:05 |
      \n| 8737 | Building A PHP Webpage Input Button for DB Connection | 2022-08-21 00:50:07 |
      \n| 9035 | Equivalent Prime Numbers Programs for Java, Python, C and JScript Testing | 2022-10-07 22:32:53 |
      \n| 9052 | JS, HTML and CSS Todo List - Saves List to JSON File | 2022-10-08 18:02:00 |
      \n| 9083 | CSS Flex Positioning Options | 2022-10-12 15:26:17 |
      \n| 9148 | CSS Grid Layouts | 2022-10-13 13:14:44 |
      \n| 9209 | Functions: Writing and Converting JS Functions to Arrow Functions | 2022-10-18 15:09:11 |
      \n| 9247 | JavaScript: Guess Number Game | 2022-10-21 15:50:35 |
      \n| 9252 | JS: Refactoring the Guess Number Game Code | 2022-10-21 16:16:53 |
      \n| 9267 | JS Behind The Scenes : Hoisting and the TDZ - Temporal Dead Zone | 2022-10-23 18:48:00 |
      \n| 9286 | WebDev Portfolio 1 - First Solo Project - Noughts and Crosses | 2022-11-10 11:53:41 |
      \n| 9292 | WebDev Portfolio 2 \u2013 Fun \"Conspiracy Theory Quiz\" | 2022-11-10 12:14:02 |
      \n| 9349 | Form Validation Types, Results Script and Non Default Web Font Use | 2022-11-10 21:56:34 |
      \n| 9366 | WebDev: Embedded Video Code for Landing Page Link | 2022-11-12 02:34:45 |
      \n| 9606 | Downgrading PHP Versions | 2022-11-16 17:30:14 |
      \n| 9614 | MYSQL DB Repair Commands | 2022-11-17 00:44:51 |
      \n| 9616 | WordPress CLI Commands and some MYSQL Repair Commands | 2022-11-17 14:01:05 |
      \n| 9656 | Uploading Your Local WordPress MYSQL Site to a New Hosting cPanel Site | 2022-11-17 16:27:36 |
      \n| 9624 | WordPress Images Not Showing - Rare Solution | 2022-11-19 15:05:19 |
      \n| 9658 | First Site Pages Speed and SEO Tweaks | 2022-11-20 14:27:02 |
      \n| 9659 | VS Code Live Server SSL Settings | 2022-11-21 17:43:06 |
      \n| 9660 | SSL on Ubuntu Apache2 - Creating Self Signed Certificates, Checking SSL Traffic with TCPDUMP and Wireshark | 2022-11-21 20:58:42 |
      \n| 9680 | Running Apache2, MYSQL and WordPress on Win11 WSL Ubuntu | 2022-11-24 22:31:58 |
      \n| 10098 | Post Titles | 2023-10-29 20:00:16 |
      \n| 10100 | All My IT Tech Post Knowledge - Introduction | 2023-10-29 20:06:16 |
      \n| 10268 | Net Client to Win11 WSL2 Access Fix, with Gemini AI, 2025 | 2025-05-31 08:27:05 |
      \n| 10288 | BitLocker Encryption with Password (No TPM Issues) | 2025-06-02 17:20:55 |
      \n| 10324 | Viewing WordPress Post Name to Number mappings in Linux MYSQL | 2025-06-03 01:19:59 |
      \n| 10346 | Clean Up Duplicate Posts - Gem AI | 2025-06-08 23:47:01 |
      \n| 10368 | Beginner's Guide to N8N and AI Agent Creation - Gemini AI | 2025-06-10 20:22:54 |
      \n| 10371 | Rare Port Conflicts with Win11 Services Stealing Apache Port 80 on Bootup | 2025-06-13 19:07:05 |
      \n| 10375 | Install rclone in WSL2 | 2025-06-14 02:46:00 |
      \n| 10386 | Building a Voice-Activated AI Chatbot for WordPress using Local LLMs | 2025-06-21 18:58:35 |
      \n| 10392 | Help with Systems Fix Steps To Set the AI Environment | 2025-06-23 02:46:27 |
      \n| 10531 | WordPress Site-Wide Content Search Project | 2025-06-23 07:23:10 |
      \n| 10435 | AI Semantic Search Project Summary | 2025-06-28 15:36:39 |
      \n| 10548 | WP Posts Word Count Data Science Exercise | 2025-06-30 23:13:25 |
      \n+-------+------------------------------------------------------------------------------------------------------------+---------------------+
      \n148 rows in set (0.00 sec)<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n
       <\/p>\n
        \n
      1. \n
        Clean Up Duplicate Slugs (Carefully!):<\/strong> This is where you need to be very methodical.<\/p>\n